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PROCESSING METHOD, PROGRAM PROVIDING 



(54) IMAGE PROCESSING APPARATUS AND IMAGE 
MEDIUM, AND DATA PROVIDING MEDIUM 

(57) It is an obtain a subpolygon having a smooth 

three-dimensional shape from a polygon 

A Bezier curve, as interpolated line B 12 which 
interpolates between vertices P 1 and P 2 of 
quadrilateral polygon P 1 P 2 P 4 P 3 is determined using 
normal vectors n, and n 2 , and an interpolated 
line B 34 interpolating between vertices P 3 and P 4 is 
determined using normal vectors n 3 and n 4 . 

Then, interpolated points P 12 and P^ are determined 
on interpolated lines B 12 and B^. Similarly, an 
interpolated line B 13 interpolating between the 
vertices P 1 and P 3 and an interpolated 
line B 24 interpolating between the vertices P 2 and P 4 are 
determined. Then interpolated points P 13 and P 24 are 
determined on interpolated lines B 13 and B 24 . In the 
same way, an interpolated line B 1234 interpolating 
between interpolated points P 12 and is determined 



and an interpolated point P 1234 is determined on 
interpolated line B 1234 . Likewise, quadrilateral 
polygon P 1 P 2 P 4 P 3 is split into 4 subpolygons, the 
quadrilateral polygons P 1 P 12 Pi234 P i3- P 12 P 2 P 24 P 1234- p 

1234 P 24 P 4 P 34 3R d P 13 P 1234 P 34 P 3' 
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Description 
Technical Field 

[0001] This invention relates to an image processing device, image processing method, a program distribution 
medium, and a data distribution medium more specifically, this invention relates to an image processing device and 
image processing method, a program distribution medium, and a data distribution medium, by which, for example, an 
image of detailed shape can be generated from rough shapes. 

Background Art 

[0002] The higher degree of integration and higher speeds achieved in processors and memories have made 
possible what was previously difficult, namely the generation of three-dimensional images in real time, making it 
possible to display three-dimensional images (three-dimensional graphics) with a sense of presence for example on 
video game machines. If a three-dimensional image is to be displayed, in many cases the three-dimensional image is 
broken up into multiple polygons (unit graphic forms), and the three-dimensional image as a whole is drawn by drawing 
each of these polygons. Thus it can be said that a three-dimensional image that is drawn in this way is defined as a 
combination of polygons. 

[0003] Three-dimensional images are produced by composing three-dimensional shapes with, for example, wire 
frames. However, to compose a wire frame the producer must set detailed parameters concerning three-dimensional 
shapes, which has been troublesome. That is, as a three-dimensional shape becomes more complex, the wire frame 
parameters must also be set in detail, which has been troublesome. 

[0004] It is an object of the present invention to make it possible to generate an image of detailed shape from 
rough shapes. 

Disclosure of Invention 

25 [0005] A image processing device according to claim 1 comprises an interpolated line computation means for 
determining an interpolated line that is the line which interpolates between two vertices from the interpolation 
vector and vertex coordinates used for determining the line that interpolates a space between a given point and 
another point in the vertices of a unit graphic form, and an interpolated point computation means for determining, as 
the vertices of sub-unit graphic forms, interpolated points which are points on the interpolated line. 
[0006] An image processing method according to claim 25 comprises an interpolated line computation step of 

30 determining the interpolated line which interpolates between two vertices from the coordinates of the vertices and an 
interpolation vector used for determining the line which interpolates between one vertex and another in the vertices 
of a unit graphic form, and an interpolated point computation step of determining, as the vertices of sub-unit 
graphic forms, interpolated points that are points on an interpolated line. 

[0007] A program distribution medium according to claim 49 provides a computer program that has an interpolated 
35 line computation step that determines the interpolated line that interpolates between two vertices from the 
coordinates of the vertices and an interpolation vector used for determining the line that interpolates between one 
vertex and another in the vertices of a unit graphic form, and an interpolated point computation step that determines, 
as the vertices of sub-unit graphic forms, interpolated points that are points on an interpolated line. 
[0008] An image processing device according to claim 74 comprises an operation means that is operated when a 
unit graphic form is input, and an interpolation vector generation means for generating an interpolation vector used 
40 for determining the interpolated line that is the line that interpolates between a given vertex and another vertex in 
the vertices of a unit graphic form that is input by the operation means being operated. 

[0009] An image processing method according to claim 91 comprises an interpolation vector generation step of 
generating an interpolation vector used for determining an interpolated line that is the line that interpolates 
between a given vertex and another vertex in the vertices of a unit graphic form that is input by the operation means 
which the latter is being operated. 
45 [0010] A program distribution medium according to claim 108 provides a computer program that has an 
interpolation vector generation step that generates an interpolation vector used for determining the interpolated 
line that is the line that interpolates between a given vertex and another vertex in the vertices of a unit graphic 
form that is input by the operation means which the latter is being operated. 

[0011] In a data distribution medium according to claim 125, if a unit graphic form is input, interpolation 
50 vectors are generated, used for determining an interpolated line which is the line that interpolates a space between 
a given vertex and another vertex in the vertices of the unit graphic form, and the data distribution medium provides 
as data concerning the image, at least the coordinates of the vertices thus obtained and the interpolation vectors at 
the vertices. 

[0012] An image processing device according to claim 133 comprises a provision device which includes an 
operation means that is operated when a unit graphic form is input, and an interpolation vector generation means that 
55 generates interpolation vectors used for determining an interpolated line that is the line that interpolates between 
a given vertex and another vertex in the vertices of the unit graphic forms input by the operated operation means, 
and a client device which has an interpolated line computation means for determining the interpolated lines from the 
coordinates of the vertices of the unit graphic forms and from the interpolation vectors, and an interpolated point 
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computation means that determines, as the vertices of sub-unit graphic forms, interpolated points that are points on 
the interpolated lines. 

[0013] In the image processing device according to claim 1 t the interpolated line computation means determines 
the interpolated line that is the line that interpolates between two vertices from the interpolation vector used for 
determining the line that interpolates the space between a given vertex and another vertex in the vertices of a unit 
graphic form and from the coordinates of the vertices, and the interpolated point computation means determines, as 
the vertices of sub-unit graphic forms, interpolated points that are points on an interpolated line. 

[0014] In the image processing method according to claim 25, the interpolated line that is the line that 
interpolates between two vertices is determined from the coordinates of the vertices and the interpolation vector 
used for determining the line that interpolates between a given vertex and another vertex in the vertices of a unit 
graphic form, and interpolated points that are points on an interpolated line are determined as the vertices of sub- 
unit graphic forms. 

[0015] In the program distribution medium according to claim 49, a computer program is provided, which 
determines the interpolated line that is the line that interpolates between two vertices from the coordinates of the 
vertices and the interpolation vector used for determining the line that interpolates between a given vertex and 
another vertex in the vertices of a unit graphic form, and determines, as the vertices of sub-unit graphic forms, 
interpolated points that are points on an interpolated line. 

[0016] In the image processing device according to claim 74, the operation means is operated when a unit graphic 
form is input, and the interpolation vector generation means generates the interpolation vector that is used to 
determine the interpolated line that is the line that interpolates between a given vertex and another vertex in the 
vertices of the unit graphic form input by the operated operation means. 

[0017] In the image processing method o according to claim 91, the interpolation vector is generated that is 
used to determine the interpolated line that is the line that interpolates between a given vertex and another vertex 
in the vertices of the unit graphic form input by the operation means when the latter is being operated. 
[0018] In the program distribution medium according to claim 108, a computer program maybe provided which 
generates an interpolation vector used for determining the interpolated line that is the line that interpolates 
between a given vertex and another vertex in the vertices of a unit graphic form that is input by the operation means 
being operated. 

[0019] In the data distribution medium according to claim 125, if a unit graphic form is input, by generating 
the interpolation vector used for determining an interpolated line that is the line which interpolates between a 
given vertex and another vertex in the vertices of the unit graphic form, there are provided as data concerning the 
image, at least the coordinates of the vertices thus obtained and the interpolation vectors at the vertices. 
[0020] In the image processing device according to claim 133, the operation means is operated when a unit 
graphic form is input, and the interpolation vector generation means generates interpolation vectors used for 
determining the interpolated line that is the line that interpolates between a given vertex and another vertex in the 
vertices of the unit graphic form input by the operated operation means. The interpolated line computation means 
determines the interpolated lines from the coordinates of the vertices of the unit graphic forms and from the 
interpolation vectors, and the interpolated point computation means determines, as the vertices of sub-unit graphic 
forms, interpolated points that are points on the interpolated lines. 

Brief Description of Drawings 

[0021] 

Figure 1 is a diagram that shows an example of the configuration of an embodiment of a data provision system to 
which the present invention applies; 

Figure 2 is a block diagram of an embodiment of the data provision device 1 of the system of Figure 1 ; 

Figure 3 is a block diagram of an embodiment of the user terminal 4 of the system of Figure 1 ; 

Figure 4 is a diagram showing polygons and normal vectors, for explaining the computation method for 
interpolated lines according to the invention; 

Figure 5 is a diagram that shows an interpolated line if angles 9 1 and 8 2 between a line segment forms with the 
tangent vectors are equal; 

Figure 6 is a diagram for explaining how control edge lengths L t and L 2 are determined in the method of the 
present invention; 

Figure 7 is a diagram for explaining how control edge lengths L, and L 2 are determined; 

Figure 8 shows a diagram for explaining how an interpolated line is determined if angles G 1 and 0 2 are different 
from each other, 
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Figure 9 is a flowchart for explaining control point computation processing; 

Figure 10 is a diagram of simulation results in which an interpolated line is determined; 

Figure 11 is a diagram of simulation results in which an interpolated line is determined; 

Figure 12 is a diagram showing simulation results in which an interpolated line is determined; 

Figure 13 is a diagram which show simulation results in which an interpolated line is determined; 

Figure 14 is a diagram for explaining how an interpolated line is determined for a polygon that comprises a 
three-dimensional shape; 

Figure 15 is a diagram for explaining fine splitting processing; 

Figure 16 is a diagram for explaining how a normal vector at a vertex of a subpolygon is determined; 

Figure 17 is a diagram for explaining the difficulties in fine splitting processing if only normal vectors at 
vertices are used as interpolation vectors; 

Figure 18 is a diagram for explaining the difficulties in fine splitting processing if only normal vectors at 
vertices are used as interpolation vectors; 

Figure 19 is a diagram for explaining fine splitting processing if both curved surface interpolation normal 
vectors and frame line interpolation normal vectors are adopted as interpolation vectors; 

Figure 20 is a flowchart for explaining splitting polygon data generation processing; 

Figure 21 is a diagram for explaining the processing of step S14 in Figure 20; 

Figure 22 is a diagram that shows how Bezier curves as frame lines that constitute a three-dimensional shape are 
drawn in sequence; 

Figure 23 is a diagram for explaining frame line interpolation normal vectors (normal vectors of frame lines); 
Figure 24 is a diagram for explaining the processing of step S16 in Figure 20; 

Figure 25 is a diagram that shows interpolated lines obtained using frame line interpolation normal vectors and 
interpolated lines obtained using curved surface interpolation normal vectors; 

Figure 26 diagrammatically shows the format of the splitting polygon data; 

Figure 27 is a flowchart for explaining fine splitting processing; 

Figure 28 is a diagram for explaining fine splitting processing; 

Figure 29 is a diagram for explaining the processing of steps S21 and S22 in Figure 27; 
Figure 30 is a diagram for explaining the processing of steps S23 and S24 in Figure 27; 
Figure 31 is a diagram for explaining the processing of step S25 in Figure 27; 
Figure 32 is a diagram for explaining the processing of step S26 in Figure 27; 
Figure 33 is a diagram for explaining the processing of step S25 in Figure 27; 
Figure 34 is a flowchart for explaining splitting processing of frame lines; 
Figure 35 is a flowchart for explaining splitting processing in the interior of a polygon; 

Figure 36 is a diagram that shows polygons that constitute a cube to be subjected to fine splitting processing; 

Figure 37 is a photograph of a halftone image appearing on a display that shows the drawing results if fine 
splitting processing is not done on the polygons of Figure 36; 
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Figure 38 is a photograph of a halftone image appearing on a display that shows the drawing results if fine 
splitting processing is done on the polygons of Figure 36; 

Figure 39 is a diagram that shows an example of generation of a squashed sphere (side views) at the state in 
which the interpolation normal vectors assigned to a cube to be subjected to fine splitting processing are modified; 

Figure 40 is a photograph of a halftone image appearing on a display that shows the drawing results if fine 
splitting processing is done on the polygons of Figure 36; 

Figure 41 is a photograph of a halftone image appearing on a display that shows the drawing results if fine 
splitting processing is done on the polygons of Figure 36; 

Figure 42 is a photograph of a halftone image appearing on a display that shows the drawing results if fine 
splitting processing is done on the polygons of Figure 36; 

Figure 43 is a flowchart for explaining the processing of user terminal in Figure 3; 

Figure 44 is a block diagram that shows an example of the electric configuration if the user terminal is 
configured as a video game machine; and 

Figure 45 is a block diagram that shows an example of the configuration of the graphic memory in Figure 44. 



Best Mode for Carrying Out the Invention 

[0022] Embodiments according to the present invention will hereinafter be described below. Before description 
therefor, characteristics of the present invention will be described as follows, by adding, in order to clarify the 
relationship between respective means of the according to claims of the invention and the embodiments described later 
on, the corresponding embodiment in brackets succeeding the description of respective means. 

[0023] An image processing device according to claim 1 is one which by processing an image defined by a 
combination of unit graphic forms splits said unit graphic forms into multiple sub-unit graphic forms, including an 
interpolated line computation means for determining an interpolated line which is the line that interpolates a space 
between two vertices from an interpolation vector used for determining a line that interpolates a space between a 
given vertex and another vertex of vertices of said unit graphic forms and from coordinates of said vertices (e.g., 
program processing steps S31 to S35 in Figure 34, program processing steps S41 l to S45 in Figure 35, etc.), and an 
interpolated point computation means for determining as vertices of said sub-unit graphic forms, interpolated points 
which are points on said interpolated line (e.g., program processing step S36 in Figure 34, program processing step 
S46 in Figure 35, etc.). 

[0024] An image processing device according to claim 3 further includes an interpolation vector computation 
means for determining said interpolation vectors at interpolated points on said first interpolated line from* said 
interpolation vectors at the first and second vertices and determining said interpolation vectors at interpolated 
points on the second interpolated line from said interpolation vectors at the third and fourth vertices (e.g., 
program processing step S36 in Figure 34, etc.). The interpolated line computation means determines the fifth 
interpolated line from said interpolation vectors at interpolated points on the first and second interpolated lines 
and from coordinates of the interpolated points. 

[0025] An image processing device according to claim 14 further includes an interpolation vector computation 
means for determining from interpolation vectors at said vertices, an interpolation vector to be used for determining 
the line which interpolates the space between a given interpolated point and another interpolated point of said 
interpolated points (e.g., program processing step S36 in Figure 34, etc.). 

[0026] An image processing device according to claim 16 further includes a correction means for correcting the 
interpolation vector at the interpolated point determined by said interpolation vector computation means (e.g., 
program processing step S37 in Figure 34, etc.). 

[0027] In an image processing device as described in claim 18, the image is a three-dimensional image, there is 
further provided a rendering means for rendering said sub-unit graphic forms (e.g., a rendering unit 25 shown in 
Figure 3, etc.). 

[0028] In an image processing device as described in claim 21, the image is a three-dimensional image. The 
interpolated line computation means includes an angle computation means for determining a first or second angle 
formed by a straight line which joins one vertex and another vertex interpolated by said interpolated line, which is 
said Bezier curve, and each projection of the straight line onto a plane perpendicular to the interpolation vector at 
said one vertex or other vertex, which is a plane that includes said one vertex or other vertex (e.g., program 
processing steps S31 to S33 in Figure 34, etc.), a distance computation means for determining, based on the first and 
second angles, a first or second control edge length, which is a distance from said one vertex or other vertex to a 
first or second control point of said Bezier curve (e.g., program processing step S34 in Figure 34, etc.), and a 
Bezier curve computation means for determining said Bezier curve as the interpolated line which interpolates the 
space between said one vertex and other vertex by determining, based on said control edge length 1 or 2, each said 
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first or second control point (e.g., program processing step S35 in Figure 34, etc.). 

[0029] An image processing device according to claim 22, if the coordinates of the vertices of said unit graphic 
forms and the interpolation vectors are recorded on a recording medium, further includes a playback means for playing 
back from the recording medium the coordinates of said vertices and the interpolation vectors (e.g., a reception / 
reproducing device 21 shown in Figure 3, etc.). 

[0030] An image processing device according to claim 23, if the coordinates of the vertices of said unit graphic 
forms and the interpolation vectors are transmitted via a transmission route, further includes a reception means for 
receiving the coordinates of said vertices and the interpolation vectors transmitted via the transmission route (e.g., 
a reception / reproducing device 21 shown in Figure 3, etc.). 

[0031] In an image processing device according to claim 24, the image is a three-dimensional image, and there 
are provided an operation means which is operated when a prescribed input is given (e.g., an input unit 28 shown in 
Figure 3, etc.), a geometry processing means for reading data concerning said unit graphic forms from a recording 
medium and performing with respect to the data, geometry processing that corresponds to input from said operation 
means (e.g., a geometry processing unit 23 shown in Figure 3, etc.), a conversion means for converting said sub-unit 
graphic forms obtained by splitting said unit graphic forms resulting after said geometry processing into ones in the 
coordinate system of a two-dimensional output device (e.g., a rendering unit 25 shown in Figure 3, etc.), and a 
rendering means for rendering said sub-unit graphic forms converted by said conversion means (e.g., a rendering unit 
25 shown in Figure 3, etc.). 

[0032] An image processing device according to claim 74 is one for processing an image defined by a combination 
of unit graphic forms, comprising an operation means which is operated when said unit graphic forms are input thereto 
(an input unit 11 shown in Figure 2, etc.), an interpolation vector generation means for generating interpolation 
vectors used for determining an interpolated line that is the line that interpolates a space between a given vertex 
and another vertex in vertices of said unit graphic forms input by said operation means when said operation means are 
operated (e.g., a data processing unit 12 shown in Figure 2, etc.), and a provision means for providing coordinates 
of the vertices of said unit graphic forms and the interpolation vectors (e.g., a transmission / recording device 18 
shown in Figure 2, etc.). 

[0033] An image processing device according to claim 82 further includes a splitting means for splitting said 
unit graphic forms into multiple sub-unit graphic forms based on the coordinates of said vertices and the 
interpolation vectors (e.g., a splitting processing unit 14 shown in Figure 2, etc., and a rendering means for 
rendering said sub-unit graphic forms (e.g., a rendering unit 15 shown in Figure 2, etc.). 

[0034] In an image processing device according to claim 83, the splitting means includes an interpolated line 
computation means for determining said interpolated lines based on the coordinates of said vertices and said 
interpolation vectors (e.g. program processing steps S31 to S35 shown in Figure 34, program processing steps S41 to 
S45 shown in Figure 35, etc.), and an interpolated point computation means for determining, as the vertices of said 
sub-unit graphic forms, interpolated points that are points on said interpolated line (e.g., a program processing 
step S36 shown in Figure 34, a plrbgram processing step S46 shown in Figure 35, etc.). 

[0035] In an image processing device according to claim 84, the splitting means further includes an 

interpolation vector computation means for determining from the interpolation vectors at said vertices, interpolation 
vectors used for determining a line that interpolates the space between a given interpolated point and another 
interpolated point in said interpolated points (e.g., a program processing step S36 shown in Figure 34, etc.). 
[0036] In an image processing device according to claim 86, the splitting means further includes a correction 
means for correcting the interpolation vector at said interpolated point determined by said interpolation vector 
computation mean (e.g., a program processing step S37 shown in Figure 34, etc.). 

[0037] In an image processing device according to claim 90, the image is a three-dimensional image, and there 
are provided the interpolated line computation means includes an angle computation means that determines a first or 
second angle formed by a straight line that joins one vertex and another vertex interpolated by said interpolated 
line, which is said Bezier curve, and each projection of the straight line onto a plane perpendicular to the 
interpolation vector at said one vertex or other vertex, which is a plane that includes said one vertex or other 
vertex (e.g. program processing steps S31 to S33 shown in Figure 34, etc.), a distance computation means that 
determines, based on the first and second angles, a first or second control edge length, which is the distance from 
said one vertex or other vertex to a first or second control point of said Bezier curve (e.g. a program processing 
step S34 shown in Figure 34, etc.). and a Bezier curve computation means that determines said Bezier curve as the 
interpolated line that interpolates the space between said one vertex and other vertex by determining, based on the 
first or second control edge length, each said first and second control point (e.g. a program processing step S35 
shown in Figure 34, etc.). 

[0038] An image processing device according to claim .133 is one for processing images defined by a combination 
of unit graphic forms, including a provision device for providing data concerning an image, and a client device for 
receiving a provision of the data from said provision device and splitting unit graphic forms defining the image into 
multiple sub-unit graphic forms. The provision device includes an operation means which is operated when said unit 
graphic forms are input (e.g., an input unit 11 shown in Figure 2, etc.), an interpolation vector generation means 
for generating interpolation vectors used for determining an interpolated line that is the line that interpolates a 
space between a given vertex and another vertex in vertices of said unit graphic forms input by said operation means 
when said operation means is operated (e.g., a data processing unit 12 shown in Figure 2, etc.), and a provision 
means for providing to said client device coordinates of the vertices of said unit graphic forms and the 
interpolation vectors (e.g., a transmission / recording device 18 shown in Figure 2, etc.). The client device includes an 
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interpolated line computation means for determining said interpolated lines from the coordinates of the vertices of 
said unit graphic forms and from said interpolation vectors (e.g., a splitting processing unit 24 shown in Figure 3, 
etc.), an interpolated point computation means for determining, as the vertices of said sub-unit graphic forms, 
interpolated points that are points on said interpolated lines (e.g., a splitting processing unit 24 shown in Figure 
3, etc.), a conversion means for converting said sub-unit graphic forms into ones in a coordinate system of a two- 
5 dimensional output device (e.g., a rendering unit 25 shown in Figure 3, etc.), and a rendering means for rendering 
said sub-unit graphic forms convened by said conversion means (e.g., a rendering unit 25 shown in Figure 3). 
[0039] It is needless to say that the above descriptions are not intended to limit the respective means to the 
above-mentioned parts or units. 

[0040] Figure 1 shows an example of a data provision system to which this invention applies ("system" means an 
10 aggregate in which multiple devices are collected together logically, regardless of whether the constituent devices 
are in the same housing). 

[0041] In this data provision system, three-dimensional image data generated on the side of a data provision 
device 1 is provided to a user terminal 4. 

[0042] That is, data for three-dimensional images, such as data about polygons that constitute a three- 
dimensional shape, is generated by the producer on data provision device 1, and it is provided to user terminal 4 by 

15 being transmitted via a transmission medium (transmission line) 2, for example, via Internet, satellite circuit, 
ground wave, cable television (CATV) network, public switched telephone network (PSTN), or integrated service digital 
network (ISDN). Or, alternatively, data for three-dimensional images generated by data provision device 1 is provided 
to user terminal 4 by being recorded on recording medium 3, for example, on optical disk, magneto-optical disk, 
magnetic disk, magnetic tape, or phase-change disk. 

20 [0043] At user terminal 4, the data provided from data provision device 1 as described above is processed, and a 
three-dimensional image is displayed. 

[0044] Figure 2 shows an example of the configuration of data provision device 1 of Figure 1 . 
[0045] Input unit 11, which is a keyboard, mouse, tablet, or similar device, is operated when data for producing 
the polygons that constitute a three-dimensional shape is to be input, when the texture to be mapped onto the 
polygons is to be specified, and when necessary commands, etc. are to be input. Here, data for producing the polygons 
25 that constitute the three-dimensional shape that is input by input unit 11 being operated is supplied to data 
processing unit 12, the specification of the texture to be mapped onto the polygons is supplied to rendering unit 15, 
and commands are supplied to the necessary block. 

[0046] Data processing unit 12 generates the coordinates of the vertices on the polygons in three-dimensional 
space, as well as the below-described interpolation vector at each vertex, by processing, using memory 12A if 
3Q necessary, the data for producing the polygons that is supplied from input unit 11, and supplies them to splitting 
database 13. Here the coordinates of the vertices of the polygons and the interpolation vectors are used for 
splitting processing of the polygons, which is described below, so in the following, for convenience, these are both 
referred to as splitting polygon data. 

[0047] Memory 12A temporarily stores the data needed for processing by data processing unit 12. Splitting 
database 13 temporarily stores the splitting polygon data from data processing unit 12. 
35 [0048] Splitting processing unit 14 reads the splitting polygon data that is stored in splitting database 13, 
performs splitting processing (fine splitting processing), which is discussed below, splits rough polygons into 
multiple fine polygons (hereafter referred to, for convenience, as subpolygons), and supplies them to rendering unit 15. 
[0049] Rendering unit 15 performs rendering processing on the subpolygons from splitting processing unit 14. 
That is, rendering unit 15 performs on the subpolygons brightness calculations, etc. for shading, and converts the 
coordinate system of the polygons in three-dimensional space into the coordinate system (screen coordinate system) of 
display unit 16 as a two-dimensional output device that displays three-dimensional images. Also, using the texture 
data stored in texture database 17, rendering unit 15 carries out calculation of the texture address for texture 
mapping, determines the final RGB values (the brightness values of the R (red) component, G (green) component, and 
B (blue) component) of each pixel that comprises display unit 16, and outputs them to display unit 16. The textures 
for texture mapping are specified by, for example, input unit 1 1 being operated. 
45 [0050] Display unit 16, which is for example a cathode ray tube (CRT) or liquid crystal display, displays the 
pixels that correspond to the RGB values from rendering unit 15. Texture database 17 stores data on textures to be 
used for texture mapping. Transmission/recording device 18 reads the splitting polygon data stored in splitting 
database 13, reads the texture data stored in texture database 17, and transmits it via transmission medium 2 or 
records it in recording medium 3. 

[0051] Next, Figure 3 shows an example of the configuration of user terminal 4 of Figure 1 . 
50 [0052] The user terminal includes a reception/playback device 21 which receives data that is transmitted via 
transmission medium 2 or plays back the data that is recorded in recording medium 3, and among this it supplies the 
splitting polygon data to a splitting database 22 and the texture data to a texture database 27. 

[0053] Splitting database 22 temporarily records the splitting polygon data from reception/playback device 21. A 
geometry processing unit 23 reads the splitting polygon data stored in splitting database 22, does geometry 
55 processing on the input from input unit 28, that is, performs coordinate conversion, clipping, etc., and supplies it 
to a splitting processing unit 24. 

[0054] Splitting processing unit 24, or rendering unit 25, to which its output is supplied, carries out the same 
processing as in the case of splitting processing unit 14 or rendering unit 15, respectively, which forms part of 
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data provision device 1 in Figure 2. A display unit 26 is constituted in the same way as display unit 16, which forms 
part of data provision device 1 in Figure 2, and it displays a three-dimensional image that corresponds to the RGB 
values from rendering unit 25. 

[0055] Texture database 27 stores the texture data from reception/playback device 21. This texture data is used 
for the texture mapping done by rendering unit 25. 

[0056] Input unit 28 is for example a keyboard, mouse, joystick, buttons, etc. and is operated by the user when 
a prescribed input (for example, in particular, information about the viewpoint) is to be input. 

[0057] Next the processing in data provision device 1 of Figure 2 will be described and in user terminal 4 of 
Figure 3. However, first the polygon splitting processing done in splitting processing unit 14 will be described, 
which forms part of data provision device 1 of Figure 2, and in splitting processing unit 24, which forms part of 

10 user terminal (client terminal) 4 of Figure 3. 

[0058] If a three-dimensional shape in a three-dimensional image is represented by polygons, the three- 
dimensional shape can be reproduced with greater fidelity by using finer polygons. However, if fine polygons are used, 
the number of polygons that represent the three-dimensional shape increases, so one must set all the data for these 
many polygons, which is troublesome; in addition, the quantity of data becomes greater. 

15 [0059] On the other hand, if a three-dimensional shape is represented by a small number of polygons, a small 
quantity of data to be set suffices, but the reproduced three-dimensional shape then becomes coarse, which degrades 
the quality of the three-dimensional image. 

[0060] In the polygon splitting that is generally done, a number of fine polygons that make up a three- 
dimensional shape are assembled to form a large polygon, and the large polygon and the original fine polygons are 
selected as necessary, so the data that must be set when constituting a three-dimensional shape is no different from 

20 the case in which the three-dimensional shape is constituted by fine polygons. 

[0061] In the polygon splitting that is done in splitting processing units 14 and 24 (called hereinafter fine 
splitting processing to distinguish it from conventional polygon splitting), from the beginning a rough polygon is 
split into detailed (fine) polygons so as to give a smooth three-dimensional shape, and even if detailed data about 
the three-dimensional shape to be realized is not given in this way, a delicate three-dimensional shape can be 
obtained by simply giving so to speak, rough data. 

25 [0062] That is, splitting processing units 14 and 24 are given, as splitting polygon data, at least the 
interpolation vectors, and the coordinates of the vertices, for determining the line that interpolates between a 
given vertex and another vertex in the vertices of the polygon, and in fine splitting processing, interpolated lines 
that are the lines that interpolate between two vertices are determined from the interpolation vectors and the 
coordinates of the vertices, and interpolated points that are points on a given interpolated line are determined as 

30 the vertices of subpolygons into which the original polygon is split. 

[0063] Here, as data for a three-dimensional image composed of polygons, generally the coordinates of the 
vertices of a polygon are given for specifying the shape of the polygon. For shading, the normal vector at each 
vertex of the polygons of a curved surface that makes up part of a three-dimensional shape to be realized by polygons 
is also given as data for the three-dimensional image. 

[0064] In fine splitting processing, the normal vectors at the vertices of the polygons are used as 

35 interpolation vectors, and the interpolated lines that interpolate between two vertices are determined. 

[0065] That is, in order now to simplify the explanation, given, as shown in Figure 4, two vertices P 1 and P 2 of a 
polygon that makes up part of a two-dimensional shape, and norma! vectors n n and n 2 at vertices P 1 and P 2 , 
respectively, we describe the method for calculating the interpolated line that interpolates between vertices 
P 1 and P 2 in this case. 

40 [0066] In this embodiment it is taken to be ideal for the interpolated line to be equal to the arc of a circle 
or ellipse that passes through the two vertices that the interpolated line interpolates, and such an interpolated 
line is to be determined. Here, all smooth curves can be approximated by a succession of minute arcs (including arcs 
of both circles and ellipses), so here one adopts as interpolated lines curves that are represented by functions that 
can approximate an arc. 

[0067] As shown in Figure 5, given normal vectors at vertices P 1 and P 2 of a two-dimensional shape that passes 
45 through vertices P n and P 2 (since normal vectors n 1 and n 2 are perpendicular to the two-dimensional shape, tangent 
vectors can be determined from these normal vectors n, and n 2 ), the angle that line segment P 1 P 2 joining 
vertices P 1 and P 2 forms with the tangent vector at vertex P 1 or P 2 , is denoted by 0 n and 9 2 , respectively. In this case, 
if 9 n and 0 2 are equal, the arc of a circle that passes through both vertices and P 2 can be taken as the interpolated 
line. 

50 [0068] The curve that is taken as the interpolated line is selected with the relationship between 6 1 and G 2 as a 
condition: for example, if 9 1 and 9 2 are equal, for example an arc of a circle that passes through both vertices 
P 1 and P 2 is taken as the interpolated line; if 9 1 and 0 2 differ by a small amount, for example an arc of an ellipse that 
passes through both vertices P, and P 2 is taken as the interpolated line; and if 9 1 and 9 2 differ by a large amount, for 
example a spline curve that passes through both vertices P, and P 2 is taken as the interpolated line. Thus sometimes 

55 the interpolated line does not vary continuously when the relationship between 9 1 and 9 2 varies. 

[0069] Thus here, for example, a Bezier curve is adopted uniformly as the interpolated line regardless of the 
relationship between 0 n and 9 2 (strictly speaking, there should be an acute accent over the "e" following the "B" in 
"Bezier"). The order of the Bezier curve is set to, for example, 3, so that arbitrary 9 n and 9 2 can be given. 



Hage: 8 



EP 0 996 094 A1 

[0070] A third-order Bezier curve is specified by four control points, two of which coincide with the starting 
point and ending point of the Bezier curve. The other two control points tie on the tangent at the starting point and 
ending point of the Bezier curve, respectively. 

[0071] Meanwhile, because the tangent vector at vertex P, and P 2 is determined based on normal vector n, or n 2 , 
respectively, the tangent direction of the Bezier curve that passes through vertex P, or P 2 is specified by giving 
normal vector n 1 or n 2 . And the starting point or ending point of the Bezier curve that is the interpolated line is 
given by vertex P 1 or P 2 (or P 2 or P^, respectively. Therefore the third-order Bezier curve as the interpolated line 
that interpolates between vertices P, and P 2 is specified uniquely if one determines a control point in the direction 
of the tangent vector at vertex P, or P 2 , respectively. 

[0072] In the situation shown in Figure 6, in the assumption that Q 1 is a control point in the direction of the 
10 tangent vector at vertex P 1( and Q 2 is a control point in the direction of the tangent vector at vertex P 2 , then the 
length L t of line segment P^ and the length of line segment P 2 Q 2 are determined (in the following, for 
convenience, and L 2 are referred to as control edge lengths). 

[0073] First, the third-order Bezier curve B that serves as the interpolated line is expressed by the following 
equation using parameter t(0sts 1) and (the coordinates of) the four control points P v P 2 , Q 1( Q 2 . 



15 



55 



B = (l-tpP, + 3(1-t) 2 tQ t + 3(1-t)t 2 Q 2 + t 3 P 2 (1) 



[0074] Now if in Figure 6 we set 0^02 = 9, then since as stated above it is ideal here that the interpolated 
line be an arc of a circle, the situation shown in Figure 7 results if Figure 6 is rewritten so that, for example, 
the origin is taken as the center C of the circle and line segment P 1 P 2 is parallel to the x-axis. In Figure 7, 1 is 
20 length L 1( 2 is interpolated line, 3 is Y-axis, 4 is length U,, R represents the intersection point of the y-axis and the 
arc of the circle that is the interpolated line, and this intersection point R caa.be determined by setting t =0.5 in 
equation (1). Here, line segment RC is the radius of the arc of the circle that is the interpolated line, and in this 
case, because center C lies at the origin, the radius of the circle is R. 

[0075] If the interpolated line is an arc of a circle, control edge lengths L 1 and will be equal, so setting this to 
25 L (= L, = L 2 ), from Figure 7 the following equations holds true. 

P 1y= P 2y= R C0S9 ' Q 1y= Q 2y= P 1y + L S ' n0 (2) 

where P 1y , Q 1y are the y-coordinates of control points P lf Q v and P 2y , Q 2y are the y-coordinates of control 
points P 2 , Q 2 , respectively. 

[0076] Also, intersection point R is expressed by the following equation by setting t to 0.5 in equation (1) and 
30 substituting the P 1y , P 2y , Q 1y , Q 2y of equation (2) for P v P 2 , Q v Q 2 . 

R = R cose/4 + 3/4 (R cos9 + L sin0) (3) 

[0077] As shown by the following equation, the length L' (= U(2 R sine)) of the control edge when the length of 
chord P^ is normalized to 1 can be determined by solving equations (2) and (3) for control edge length L and 
35 dividing it by the length (2 R sine) of chord P 1 P 2 . 

U = 2/(3(1 + cos0)) (4) 

[0078] After control edge length L* is determined from equation (4), by using this control edge length L* and vertex P 
! or P 2 , control point or Q 2 , respectively, can be determined, and therefore the Bezier curve is specified as the 
40 interpolated line. 

[0079] In the foregoing, 0 n and 0 2 are equal, but even if 9, and e 2 are different, by performing a transformation to 
expand/contract one axis, control points and Q 2 can be determined in the same way as if 0 1 and 0 2 are equal. 
[0080] That is, if 0 1 and 0 2 are different, as shown in Figure 8(A), the triangle formed by vertices P 1 and P 2 and 
intersection point P' where the tangents at vertex P 1 or P 2 intersect with each other will be a scalene triangle 
45 (whereas in the case in Figure 7 it is an isosceles triangle), and here the length of side P^' or P 2 P* of this scalene 
triangle are denoted by k, or k^ respectively. Also, the length of side P 1 P 2 is denoted by K. 
[0081] In this case, the following equations hold true. 

k, sin0 1 = k 2 sin0 2 , k 1 cos0 1 + k 2 cose 2 = K (5) 
Also, K can be determined from the coordinates of vertices P, and P 2 . 
50 [0082] Solving equation (5) for k 1 and k 2 , we get the following equations. 

k 1 = K sine^sinOj cos0 1 + cose 2 sine^ 
k 2 = K sin0 1 /(sin0 2 cose l + cos6 2 sine^ 



(6) 



[0083] Meanwhile, if for example as shown in Figure 8(B), denoting by V the perpendicular dropped from 
point P 2 to straight line P,P\ if point P 2 is moved along perpendicular V so as to deform triangle P 1 P 2 P' into triangle 
p i P 2 P ' (expansion transformation or contraction transformation) as shown in Figure 8(C), then the ratio of control 
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edge length L, from control point P 2 to Q 2 in triangle P^P' before the deformation to control edge length L2' from 
control point P 2 * to Q 2 * in triangle P^'F after the deformation will be equal to the ratio of length k 2 of side P-P' in 
triangle P,P 2 P' before the deformation to length k 2 ' of side P 2 'P' in triangle P^'P' after the deformation and as a 
result, the following equation holds true 



k 2 :k 2 ' = L 2 :L 2 * (7) 



l < t ] n r , ( The j refore ,f trian 9 ,e p i p 2 'P' after the deformation is made into an isosceles triangle in which the length 
of side P^ and the length of side P 2 'P' are equal (but in order to make triangle P,P 2 'P\ after a deformation by an 
expansion/contraction transformation of one axis, into an isosceles triangle, 9, and 0 2 must be formed on the same side 
10 ° f cnord P1P2). then control edge length L/ can be determined by equation (4), and control edge length U can be 
determined from equations (6) and (7). That is, control edge length L 2 can be determined by the following equation. 

L 2 = Kxk2x2x cosG' x 2/(3(1 + cos9')) (8) 



[0085] Similarly, control edge length L 1 can be determined by the following equation. 

L 1 = Kxk 1 x2x cosG' x 2/(3(1 + cosG')) (9) 

[0086] The 6' in equations (8) and (9) denotes the angle formed between side P,P 2 and side P'P' in triangle 
P 1 P 2 , P ( after the deformation (9 2 * in Figure 8(C)) (or the angle formed by side P,P 2 and side P,P' (6/ in Figure 8(C)) ( 

20 [0087] After control edge length L, or U, has been determined as described above, control point Q 1 or Q, can be 
determined from vertex P, or P 2 , respectively, and thereby the Bezier curve is specified as the interpolation line 
[0088] Although 0' can be accurately determined by expressing the contraction transformation with a numerical 
expression, in this embodiment, in order to reduce the increase in the amount of calculation, cosG' is approximated bv 
s in the following equation. 1 

25 cose = S = (cos8 1 + cos8 2 )/2 (10) 

[0089] In this case, control edge lengths L t and L 2 are determined according to the following equations. 

L 1 = Kxk 1 x2xsx 2/(3(1 + s)) 

L 2 = Kxk 2 x2xsx 2/(3(1 + s)) (1 1 > 

30 



[0090] Next, referring to the flowchart in Figure 9, the method will be described for calculating control points Q, and 
Q 2 (control point computation processing) for specifying the Bezier curve that is the interpolated line 
35 [0 °r? 13 « ,n com P utin 9 contr ° l P° ints Qi an d Q 2 . first, in step S1, length k, or k 2 of side P,P' or P ? P' of triangle P,P,P' 
in Figure 8(A) is determined according to equation (6), then one proceeds to step S2. In step S2, the approximate 
value s of the cosine of base angle 9' (= e,' = e 2 ') when triangle P,P 2 P' is deformed, by perforating an 
expansion/contraction transformation, to isosceles P^'P' as shown in Figure 8(C) is determined according to 
equation (10) then one proceeds to step S3. In step S3, equations (11) are calculated to determine control edge 
lengths L| and L 2 , thereby determining control points Q 1 and Q 2 . 
40 [0092] Figures 10 through 13 show the results of simulations in which K = 1 is set, control points Q, and are 
determined and the interpolated line is determined that is the Bezier curve specified by these control points 
Q, and Q 2 . In Figures 10 through 13, (A) shows the radius of curvature of the interpolated line, and (B) shows the 
shape of the interpolated line. Also, Figure 10 shows the case where 0 1 = 9 2 = 18 degrees, Figure 1 1 shows the case 
where 8 1 = 18 degrees and 9 2 = 22 degrees, Figure 12 shows the case where 9; = 28 degrees and % = 32 decrees 
and Figure 1 3 shows the case where 0 n = 20 degrees and 9 2 = 60 degrees. 

[0093] The foregoing concerns a polygon that is part of a two-dimensional shape, but for a polygon that is part 
of a three-dimensional shape, the normal vectors n, or ru, at its two vertices P 1 or P 2 are in general in mutually 
twisted positions. As shown in Figure 14, the angle formed by line segment P n P 2 and the projection (orthogonal 
projection) of this line segment P,P 2 onto the plane A which is perpendicular to normal vector n t and includes 
vertex P, is adopted as the 9, in equations (6) and (10). That is, the unit vector in the direction of the projection 
of line segment P 1 P 2 onto the plane including vertex P, that is perpendicular to normal vector n- is taken as the 
tangent vector B of the three-dimensional shape at vertex P v and the angle formed by this tangent vector and line 
segment P^ 2 is taken as the 9 1 in equations (6) and (10). 

[0094] Similarly, the angle formed by line segment P,P 2 and the projection of this line segment P,P 2 onto the 
plane C including vertex P 2 that is perpendicular to normal vector n 2 is taken as the 9 2 in equations (6) and (10). 
55 [0095] In the following, as explained in Figure 9, by determining control points Q, and Q 2 , the Bezier curve can be 
determined as the interpolated line that interpolates between vertices P 1 and P 2 . In this case, the Bezier curve as the 
interpolated line is generally a curve that is spatially twisted, but because the bulge is near to that of a circle 
or ellipse, ultimately it interpolates smoothly between vertices P n and P 2 . 
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[0096] After the interpolated line is determined as described above, in fine splitting processing, as stated 
above, interpolated points on a given interpolated line are determined as vertices of subpolygons into which the 
original polygon is split, and these interpolated points can be determined by inputting an appropriate value for 
parameter t in equation (1), which expresses the Bezier curve as the interpolated line. 

[0097] The interval between vertices P, and P 2 can be split into M parts by setting M-1 interpolated points 
between them, and if this is done, then it suffices to calculate equation (1) with parameter t set to, for example 
i/M (i = 1, 2, .... M-1). 

[0098] Next the case, as shown for example in Figure 15, will be described in which four vertices 

P, through P 4 are shown, and fine splitting processing is done on quadrilateral polygon P 1 P 2 P 4 P 3 that is part of a 
three-dimensional shape and in which line segments P^ and P 3 P 4 lie opposite each other, and line segments 
P,P 3 and P 2 P 4 lie opposite each other. 

[0099] Assuming now that the interval between vertices P, and P 2 is split into, for example, two parts (in this 
case, the interval between vertices P 3 and P4, which lies opposite line segment P 1 P 2 , is also split into two parts), 
as explained in Figure 9, interpolated line B 12 (a first interpolated line), which interpolates between vertices P 1 and P 2 , 
is determined, and interpolated fine (a second interpolated line), which interpolates between vertices P 3 and P 4 , is 
determined. And interpolated point P 12 or P 34 can be determined on interpolated line B 12 or B 34 by computing equation 
(1) with parameter t set to, for example, 0.5. 

[0100] In this way, quadrilateral polygon P 1 P 2 P 4 P 3 is split into two subpolygons, the quadrilateral polygons P^^P 
34P3 and P 12 P 2 P 4 P 34 . 

[0101] And if the interval between vertices P, and P 3 and the interval between vertices P 2 and P 4 are each split 
into two parts, then, likewise as explained in Figure 9, interpolated line B 13 (a third interpolated line), which 
interpolates between vertices P 1 and P 3 , is determined, and interpolated line B 24 (a fourth interpolated line), which 
interpolates between vertices P 2 and P 4 , is determined. And interpolated point P 13 or P 24 can be determined on 
interpolated line B 13 or B 24 by computing equation (1) with parameter t set to, for example, 0.5. 

[0102] And in this case, interpolated line B 1234 (a fifth interpolated line), which interpolates between interpolated 
points P 12 and P^, which were previously determined as the vertices of subpolygons, is also determined as explained 
in Figure 9. And interpolated point P 1324 can be determined on interpolated line B 1234 by computing equation (1) with 
parameter t set to, for example, 05. 

[0103] In this way, quadrilateral polygon P 1 P 2 P 4 P 3 is split into four subpolygons, the quadrilateral polygons P,P 12 P 

I234P13* P 12 P 2 P 24' P 1234» P 1234 P 24 P 4 P 34» an0 * P 13 P 1234 P 34 P 3' 

[0104] Here quadrilateral polygon P^P^ is split into 2x2 (horizontal x vertical) subpolygons, but if 

quadrilateral polygon P^^Pg is to be split into MxN subpolygons, it suffices to split the interval between 
vertices P 1 and P 2 and the interval between P 3 and P 4 each into M parts, split the interval between vertices 
P^ and P 3 and the interval between P 2 and P 4 each into N parts, and split into N parts the interval between 
corresponding members of the M-1 interpolated points that split the interval between vertices P A and P 2 into M parts 
and the M-1 interpolated points that split the interval between vertices P 3 and P 4 into M parts. But quadrilateral 
polygon P^P^ can also be split into many subpolygons by repeating a process in which quadrilateral polygon P 1 P 2 P 
4 P 3 is split by fine splitting processing into two subpolygons P^P^ 2 p za p z and P 12 P 2 P 4 P 34- and tnese two 
subpolygons P 1 P 12 P 3 4 P 3 and P 12 P 2 P 4 P 34 are eacn SP 1 '* bv fine splitting processing into two further subpolygons. 
[0105] In fine processing, since the interpolated line that interpolates between two vertices is determined 
using the coordinates and normal vectors of the two vertices, in determining interpolated line B 1234 that interpolates 
between interpolated points P 12 and P^, for example in the case illustrated in Figure 15, it is necessary to have 
normal vectors n 12 or at interpolated points P 12 or P^, respectively. And even if an interpolated point with 
another interpolated point is an interpolated point that cannot be determined (in the case of Figure 15, interpolated 
points P 13 , P 24 , P 1234 ), because the interpolated point is the vertex of a subpolygon, a normal vector is needed to do 
shading in rendering processing. 

[0106] A normal vector at a vertex of a subpolygon (except a vertex of the original polygon) is determined here 
for example as follows. 

[0107] Namely, taking the example of interpolated point P 12 that splits the interval between vertices P, and P 2 , its 
normal vector n 12 is determined, as shown in Figure 16, by linear interpolation using normal vector n, at vertex P-, and 
normal vector n 2 at vertex P 2 . 

[0108] Specifically, if parameter t that is substituted in equation (1) when interpolated point P 12 on interpolated 
line B 12 is to be determined is set to T, then unit vector nn 12 , which corresponds to the sum of (1-T) times normal 
vector n 1 plus TT times normal vector n 2 is determined according to the following equation. 

nn 12 = ((1-TJn, + Tn 2 )/\(%T)n, + Tn 2 | (12) 
where |x| represents the norm of vector x. 

[0109] The vector nn 12 obtained by equation (12) is equal to the normal vector determined in Phong shading. 
[01 10] Vector nn 12 may be adopted without modification as normal vector n 12 at interpolated point P 12 , but because 
vector nn 12 is obtained by linear interpolation using normal vectors n, and n 2 , it is difficult to say that it 
faithfully reflects the shape of interpolated line B 12 . So here we correct vector nn 12 as follows, and adopt the corrected 
vector as normal vector n 12 at interpolated point P 12 . 
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[0111] That is, first we determine tangent vector s 12 of interpolated line B 12 at interpolated point P 12 . Here tangent 
vector s 12 can be determined from equation (1). 

[0112] Then we determine the vector product nn 12 ' of vector nn 12 and tangent vector s 12 according to the 
following equation. 

5 nn 12 = nn 12 x s 12 (13) 

[0113] Then we determine the vector product of tangent vector s 12 and vector nn 12 ' and set this to normal 
vector n 12 at interpolated point P 12 as shown in the following equation. 

n 12 = s 12 xnn 12 ' (14) 
10 Here the "x" in equations (13) and (14) represents a vector product. 

[0114] Because normal vector n 12 determined as described above faithfully expresses the shape of interpolated 
line B 12 , which is a Bezier curve, by using this in shading (highlight calculation, etc.), we can obtain an image 
whose brightness distribution accurately reflects the shape of interpolated line B 12 . 

[0115] As described above, with fine splitting processing the normal vector is used as an interpolation vector, 
75 the interpolated line that interpolates between two vertices is determined from the normal vectors and the 
coordinates of the vertices, and an interpolated point on a given interpolated line is determined as the vertex of a 
subpolygon into which the original polygon is split, so one can compose a delicate three-dimensional shape from 
polygons of rough shape. 

[0116] And because the locality of the interpolation is preserved here, that is, because for example in Figure 
15 each normal vector of an interpolated point that splits the interval between vertices P 1 and P 2 is determined from 

20 normal vector n 1 at vertex P 1 and normal vector n 2 at vertex P 2 , the subpolygons obtained by splitting quadrilateral 
polygon P 1 P 2 P 4 P 3 and the subpolygons obtained by splitting another polygon that abuts quadrilateral polygon 
P 1 P 2 P 4 P 3 at its side P 1 P 2 are connected continuously, and thus a smooth three-dimensional shape can be obtained. 
[0117] In the case described above, a quadrilateral polygon has been considered. However, fine splitting 
processing can also be done on a polygon that has a different number of sides than four. For example, if done on a 

25 triangular polygon, fine splitting processing can be done on a triangular polygon in the same way as on a 
quadrilateral polygon by thinking of one of the pairs of vertices P t and P 2 , P 3 and P 4 , and P 3 , or P 2 and P 4 that make 
up the aforesaid quadrilateral polygon P 1 P 2 P 4 P 3 as being the same vertex. 

[0118] Here, texture coordinates at the vertices of the subpolygons are required for doing texture mapping on the 
subpolygons that result from fine splitting processing; but these can be determined in the same way that, for example, 
normal vector nn 12 at interpolated point P 12 is determined, as explained in Figure 16. That is, although it was not 

30 stated above, the data on the three-dimensional image that is generated in data provision device 1 includes, besides 
splitting polygon data and texture data, the texture coordinates at each vertex of the original polygons; for example, 
the texture coordinates at interpolated point P 12 , which splits the interval between vertices P n and P 2 , can be 
determined by adding (linearly interpolating) the texture coordinates at vertex P 1 and the texture coordinates at 
vertex P 2 in accordance with the ratio 1-t:t corresponding to parameter t substituted in equation (1) for determining 

35 interpolated point P 12 . 

[0119] If the shape of the interpolated line B 12 between vertices P 1 and P 2 is biased (for example, if the radius 
of curvature of the part near one or the other of vertex P 1 or P 2 is large, and the radius of curvature of the part near 
the other is small), there will arise distortion in the texture if texture mapping is done using the texture 
coordinates determined by linear interpolation as described above. That is, if parameter t substituted in equation (1) 
for determining interpolated point P 12 assumes, among the values it may assume, for example its midpoint value 0.5, 

40 but because of the shape of interpolated line B 12 is biased, interpolated point P 12 is set in a position where its 
distance along interpolated line B 12 is very close to, say, vertex P 1 between vertex P 1 or P 2 , then texture distortion 
will arise, if texture mapping is done using the texture coordinates determined by linear interpolation. 
[0120] In cases where such texture distortion is a problem, it suffices to do curvilinear integration along 
interpolated line B 12 determine the distance along interpolated line B 12 from vertex P 1 or P 2 , respectively, to 

45 interpolated point P 12 , and, according to this distance correct the ratio that is used when the texture coordinates at 
interpolated point P 12 are determined by linear interpolation. That is, it suffices to make a correction whereby the 
ratio that is used when the texture coordinates at interpolated point P 12 are determined by linear interpolation is made 
to approach (or set equal to) the ratio between the distance along interpolated line B 12 from vertex P 1 to interpolated 
point P 12 and the distance along interpolated line B 12 from vertex P 2 to interpolated point P 12 . 

[0121] Next, in many cases a smooth three-dimensional shape can be realized by doing fine splitting processing 
using the normal vectors at the vertices as the interpolation vectors, but depending on the three-dimensional shape 
to be realized, it is sometimes inadvisable to use only the normal vectors at the vertices as the interpolation vectors. 
[01 22] That is, there are for example cases where, with a circular cylinder or other body of revolution made by 
rotating a plane shape about an axis of rotation, or a similar three-dimensional shape, there is a large discrepancy 
between the direction of the orthogonal projection of the line segment that joins a given vertex a of a polygon that 
55 is part of the three-dimensional shape and another vertex b (where vertex b is a vertex that is adjacent to vertex a) 
onto the plane that is perpendicular to the normal vector at vertex a, and the tangent direction (hereafter called, 
for convenience, the frame line direction) at vertex a of the curve (hereafter called, for convenience, the frame 
line) that joins vertices a and b along the three-dimensional shape to be realized; in such a case, if fine splitting 
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processing is done as described above, then the interpolated line that joins vertices a and b will, so to speak, be 
in a bent state, and if texture mapping is done, the texture will appear unnatural. 

[0123] Specifically, consider a case in which a three-dimensional shape, as shown for example in Figure 17(A), 
is composed of rough polygons, and the three-dimensional shape resulting from rotating this about axis of rotation Y 
is to be realized. Normal vector A at vertex a, which is the intersection point of sides 1 and 2 of polygon p that is 
part of the three-dimensional shape of Figure 17(A), is a vector in an obliquely upward direction, which is a 
direction that is roughly perpendicular to polygon p. In this case, there is a large discrepancy between the frame 
line direction at vertex a and the direction of the orthogonal projection of line segment ab (side 1) that joins this 
vertex a and another vertex b of polygon p onto the plane that is perpendicular to the normal vector at vertex a. 
That is, in this case, because normal vector A is a vector in an obliquely upward direction, the direction of the 
orthogonal projection of line segment ab (side 1) onto the plane that is perpendicular to the normal vector has a 
tilt with respect to the plane that is perpendicular to axis of rotation Y. On the other hand, the frame line 
direction at vertex a is the tangent direction, at vertex a, of the circle that is the locus of vertex a if polygon p 
is rotated about axis of rotation Y, so it is parallel to the plane that is perpendicular to axis of rotation Y. 
[0124] In this case, if fine splitting processing is done on polygon p, then the interpolated line that 

interpolates between vertices a and b will be bent as shown in Figure 17(B), and it will be difficult to compose a 
15 smooth three-dimensional shape. 

[0125] Also, if there is no need to perform fine splitting processing on the polygons and make the three- 
dimensional shape that is composed by the subpolygons thus obtained into a specified shape and the above-mentioned 
bending of the interpolated line causes no problems, then it suffices to use only the normal vectors at the vertices 
as interpolation vectors. But if the above-mentioned bending of the interpolated line causes problems or if it is 
necessary to make the three-dimensional shape composed by the subpolygons into a specified shape, then it maybe 
20 impossible to realize the specified shape by using only the normal vectors at the vertices as the interpolation vectors. 

[0126] That is, if, for example, as shown in Figure 18, fine splitting processing is to be done on quadrilateral 
polygon abdc, thereby composing circle O, which is the base of a circular cylinder as indicated by the dotted line in 
this diagram, then it will be necessary to split quadrilateral polygon abdc into subpolygons so as to compose circle 
O, which will be the base of the circular cylinder. But in this case, denoting normal vectors A through D at vertices 
25 a through d, respectively, vectors are given that are perpendicular to circle O that forms the base, so if fine 
splitting processing is done using such normal vectors A through D, quadrilateral polygon abdc will be split in a 
direction parallel to side ab (cd) or side ac (bd). That is, splitting will not be done on the subpolygons that are 
to compose circle O. 

[0127] This is due to the same reason explained with Figure 17. Namely, in Figure 18, the direction of the 
orthogonal projection of the line segment that joins a vertex a with another vertex b onto the plane that is 

30 perpendicular to normal vector A at vertex a coincides with the direction of line segment ab. On the other hand, the 
curve along the three-dimensional shape to be realized that joins vertices a and b, that is, the frame line, is an 
arc ab that is part of circle O, and the tangent direction of this arc ab at vertex .a, that is, the frame line 
direction, is the direction of the tangent of circle O at vertex a. Therefore the direction of the orthogonal 
projection of line segment ab onto the plane that is perpendicular to normal vector A at vertex a of quadrilateral 
polygon abdc that composes the circular cylinder differs greatly from the frame line direction at vertex a, so 

35 quadrilateral polygon abdc is not split into subpolygons so as to compose circle O. That is, with fine splitting 
processing, the interpolated line that interpolates between vertices a and b is formed in such a way that it touches 
the orthogonal projection of line segment ab onto the plane that is perpendicular to normal vector A at vertex a and 
touches the orthogonal projection of line segment ab onto the plane that is perpendicular to normal vector B at 
vertex b, while the frame line, which is the curve that joins vertices a and b along the circular cylinder to be 
realized, is arc ab, so the interpolated line and the frame line are different, and quadrilateral polygon abdc is not 
split into subpolygons so as to compose circle O (the circumference of the circle), which is the frame line (one only 
does splitting so that sides ab, cd, ac, bd are each taken without modification as an interpolated line). 
[0128] As interpolation vectors at a given vertex not only the normal vector at that vertex has been adopted but 
also a vector (the interpolated line direction vector) that expresses the direction (the frame line direction) of the 
frame line that passes through that vector. If fine splitting processing is done using the vector that expresses the 

45 frame line direction as an interpolation vector, the interpolated line is formed in such a way that it coincides with the 
frame line (because this is something that constitutes an interpolated line such that the vector that expresses the 
frame line direction coincides with the frame line if it is used in the fine splitting processing), and the polygons 
are split into subpolygons to compose the three-dimensional shape to be realized. 

[0129] As vectors that express the frame line direction at a vertex, there are, for example, the tangent vector 
at the vertex (corresponding to the slope of a curve in a two-dimensional plane) and the normal vector of the frame 
50 line at the vertex (the definition of the normal vector of a frame line is discussed below), but here we adopt the 
normal vector of the frame line. 

[0130] If fine splitting processing is done using the normal vectors (the normal-direction vectors of the three- 
dimensional shape to be realized) at the vertices that are given for shading, the normal vector faces the normal 
direction of the curved surface that is the three-dimensional shape to be realized, so the polygons are split into 
55 subpolygons so as to compose the curved surface that is the three-dimensional shape to be realized. That is, if fine 
splitting processing is done using as interpolation vectors the normal vectors at the vertices that are given for 
shading, splitting into subpolygons is done so as, so to speak, to interpolate the curved surface that is the three- 
dimensional shape to be realized. Thus in the following, for convenience, these normal vectors are referred to as 
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curved surface interpolation normal vectors. 

[0131] On the other hand, if fine splitting processing of polygons is done using the normal vectors of the frame 
lines, then the sides that make up a polygon are split into subpolygons that have sides that, so to speak, 
interpolate the frame lines, that is, the curves (curves included in curved surfaces) that constitute the curved 
surface that is the three-dimensional shape to be realized. In following, for convenience, these normal vectors are 
referred to as frame line interpolation normal vectors. 

[0132] If for example the circular cylinder indicated by the dotted line in Figure 18 is composed with 

subpolygons obtained by fine splitting processing, the curved surface interpolation normal vectors at vertices a 
through d of quadrilateral polygon abdc are normal vectors A through D, respectively, and the frame line 
interpolation normal vectors at vertices a through d are unit vectors in the direction of straight lines extending 

10 from the center of circle O toward vertices a through d. 

[0133] If not just curve interpolation normal vectors but also frame line interpolation normal vectors are 

adopted as interpolation vectors, then frame line interpolation normal vectors are used when determining interpolated 
points (for example, interpolated points P 12 , P 23 , P 13 , P 24 in Figure 15) that interpolate between adjacent vertices in 
the onginal polygon that is the object of fine splitting processing, and curved surface interpolation norma! vectors 
are used when determining, so to speak, internal interpolated points in the original polyqon (for example 

is interpolated point P 1234 in Figure 15). ' 
[0134] If such fine splitting processing is done on, for example, quadrilateral polygon abdc in Figure 18, then 
frame line interpolation normal vectors are used as interpolation vectors for each of the intervals between vertices 
a and b, between vertices b and d, between vertices d and c, and between vertices c and a, and interpolated points 
are determined as described above. As a result, interpolated points are formed on arcs ab, bd, dc, and ca. In the 

20 interior of quadrilateral polygon abdc, curved surface interpolation normal vectors are used as interpolation vectors, 
and interpolated points are determined as described above. As a result, interpolated points are formed in the plane 
that includes circle O. As a result, quadrilateral polygon abdc is split into subpolygons so as to constitute circle O. 
[0135] That is, if for example fine splitting processing is done so as to generate four subpolygons by splitting 
quadrilateral polygon abdc into two parts in each of the directions of sides ab (cd) and ac (bd), then when, as shown 
in Figure 19(A), each of vertices a through d is given a frame line interpolation normal vector in the direction from 

25 the center of circle O toward vertex a through d, respectively, and each is given a curved surface interpolation 
normal vector in a direction perpendicular to circle O (in Figure 19(A), in the direction flying out perpendicularly 
from the surface of the diagram), then first for the interval between vertices a and b or the interval between 
vertices c and d, the frame line interpolation vectors are used as interpolation vectors, and arc ab or cd, 
respectively, is determined as the interpolated line, and interpolated point e or f is set on the respective 
interpolated line, as shown in Figure 19(B). Likewise for the interval between vertices a and c or the interval 
between vertices b and d, the frame line interpolation vectors are used as interpolation vectors, and arc ac or bd, 
respectively, is determined as the interpolated line, and interpolated point g or h is set on the respective 
interpolated line, as shown in Figure 19(C). 

[0136] Also, for example for the interval between interpolated points e and f (or the interval between 
interpolated points g and h), line segment ef is determined as an interpolated line using curve interpolation normal 
35 vectors as interpolation vectors, and interpolated point i is set on this interpolated line as shown in Figure 19(D). 
As a result, as shown in Figure 1 9(D), > quadrilateral polygon abdc is split into quadrilateral polygons aeig, ebhi 
hdfi, fcgi as four subpolygons to comprise circle O. 

[0137] By the above-described fine splitting processing, a polygon is split into detailed (fine) polygons so as 
to give a smooth three-dimensional shape, so even if detailed data about the three-dimensional shape to be realized 
is not given by data provision device 1, a delicate three-dimensional shape can be composed and presented to the user 
40 just by giving rough data concerning the shape. Also, on the side of user terminal 4, a delicate three-dimensional 
shape can be reproduced from sparse data. 

[0138] Next, the processing of data provision device 1 of Figure 2 will be described. 

[0139] When input unit 11 is operated by the producer so as to compose a three-dimensional shape, splitting 
polygon data generation processing that generates the splitting polygon data used for fine splitting processing is 

^ 5 performed by data provision device 1. 

[0140] Referring to the flowchart in Figure 20, we describe the splitting polygon data generation processing. 
[0141] In splitting polygon data generation processing, first, in step S11, data processing unit 12 decides 
whether the coordinates (coordinates in three-dimensional space) of the vertices of the polygons that comprise the 
three-dimensional shape and the normal vectors of the frame lines at the vertices (as stated below, these will be 
used as the frame line interpolation vectors) have been input from input unit 11. 

50 [0142] In step S11, if it is decided that the coordinates of the vertices and the normal vectors of the frame 
lines at the vertices have not been input, one skips step S12 and proceeds to step S13. 

[0143] If in step S11 it is decided that the coordinates of the vertices and the normal vectors of the frame 
lines at the vertices have been input, that is, if the coordinates of the vertices and the normal vectors of the 
frame lines at the vertices have been input by the producer operating input unit 11, then one proceeds to step S12, 
the coordinates of the vertices and the normal vectors of the frame lines at the vertices that have been input are 
temporarily stored in memory 12A and one proceeds to step S13. 

[0144] In step S13, data processing unit 12 decides whether input unit 1 1 has been operated so as to confirm the 
stored content of memory 12A as splitting polygon data (hereafter called, for convenience, confirmation operation). 
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If in step S13 it is decided that confirmation operation has not been done by input unit 11, one returns to step S11 
and thereafter repeats the same processing. 

[0145] If in step S13 it is decided that confirmation operation has been done by input unit 11, one proceeds to 
S14, and data processing unit 12 reads the stored content of memory 12A and supplies it to, and stores it in, 
splitting database 13. Also, data processing unit 12 for example goes through the vertices in the order in which they 

5 were input and determines, based on the stored content of memory 12A third-order Bezier curves in which the angle 
formed with the normal vector of the frame line at each vertex is 90 degrees, and supplies this, via splitting 
database 13, splitting processing unit 14, and rendering unit 15. to display unit 16 and causes it to be displayed. 
[0146] In this way, as shown in Figure 21, Bezier curves (indicated in the diagram by the dotted line) as the 
frame lines that constitute the three-dimensional shape are displayed on display unit 16. 

10 [0147] Thereafter, one proceeds to step S15, where data processing unit 12 decides whether input unit 11 has 
been operated so as to add any input of coordinates of the vertices and normal vectors of the frame lines at the 
vertices (hereafter called, for convenience, additional operation). If in step S15 it is decided that additional 
operation has been done by input unit 11, the stored content of memory 12A is cleared, one returns to step S11, and 
thereafter, by repeating the processing of steps S11 through S15, Bezier curves as the frame lines that constitute 
the three-dimensional shape are drawn one after another. 

15 [0148] That is, for example, as shown in Figure 22(A), the producer inputs the coordinates of vertex P 1 and normal 
vector (frame line interpolation normal vector) A 1 of the frame tine at this vertex P v as well as the coordinates of 
vertex P 2 and normal vector A 2 of the frame line at this vertex P 2 , and if confirmation operation is done by input unit 
11, data processing unit 12 determines Bezier curve P^ as a frame line that comprises the three-dimensional shape, 
and causes display unit 16 to display it. Also, the producer does additional operation on input unit 11 and, for 

2 0 example, as shown in Figure 22(A), inputs the coordinates of vertex P 3 and normal vector A 3 of the frame line at this 
vertex P 3 , as well as the coordinates of vertex P 4 and normal vector A 4 of the frame line at this vertex P 4 , and if 
confirmation operation is done on input unit 11, data processing unit 12 determines Bezier curve P 3 P 4 as a frame line 
that comprises the three-dimensional shape, and causes display unit 16 to display it. 

[0149] Thereafter, the producer does additional operation on input unit 11, and, for example, as shown in Figure 
22(B), inputs the coordinates of vertex P 1 and normal vector (frame line interpolation normal vector) B n of the frame 
25 line at this vertex P v as well as the coordinates of vertex P 3 and normal vector B 3 of the frame line at this vertex P 3 , 
and if confirmation operation is done by input unit 11, data processing unit 12 determines Bezier curve P t P 3 as a frame 
line that comprises the three-dimensional shape, and causes display unit 16 to display it. Also, the producer does 
additional operation on input unit 11 and, for example, as shown in Figure 22(B), inputs the coordinates of 
vertex P 2 and normal vector B 2 of the frame line at this vertex P 2 , as well as the coordinates of vertex P 4 and normal 
vector B 4 of the frame line at this vertex P 4 , and if confirmation operation is done on input unit 11, data processing 
unit 12 determines Bezier curve P 2 P 4 as a frame line that comprises the three-dimensional shape, and causes display 
unit 16 to display it. 

[0150] Here, in Figures 22(A)-22(B) there are shown for example two vectors A, and B 1 as normal vectors of the 
frame line of vertex P v However, vector A 1 or B 1 is perpendicular to curve P 1 P 2 or P^, respectively. Similarly, vector A 
2 or B 2 is perpendicular to curve P n P 2 or P 2 P 4 , vector A3 or B 3 is perpendicular to curve P 1 P 3 or P 3 P 4 , and vector A 4 or 
B4 is perpendicular to curve P 3 P 4 or P 4 P 2 , respectively. 
[0151] Also, given two vertices P 1 and P 2 and normal vector A 1 or of the frame line at such vertex P 1 or P 2 , 
data processing unit 12 goes through these two vertices P^ and P 2 and determines third-order Bezier curves, as frame 
lines comprising the three-dimensional shape, in which the angle formed with normal vector A 1 or A^ respectively, is 
90 degrees; this is determined, for example, in the following way. 
40 [0152] Namely, as shown in Figure 23, data processing unit 12 determines line segment P/P^, which is the 
projection (orthogonal projection) of line segment P^P 2 onto plane R, which includes vertex P 1 and is perpendicular to 
normal vector A v In the same way, data processing unit 12 determines line segment P/'P^' (not shown), which is the 
projection of line segment P 1 P 2 onto the plane that includes vertex P 2 and is perpendicular to normal vector A 2 . With 
the data processing unit 12, control points Q 1 and Q 2 are determined, as explained in Figure 9, from the coordinates 
of vertices P 1 and P 2 and from the angle formed by line segment P 1 P 2 and line segment P/P2* and the angle formed by 
line segment P 1 P 2 and line segment P/'P^', and the third-order Bezier curve specified by these control points 
and Q 2 as well as control point P^ and P 2 is determined as a frame line that composes the three-dimensional 
shape. 

[0153] The Bezier curve as the frame line that is thus determined coincides with the interpolated line that is 
obtained if fine splitting processing is done by taking as interpolation vectors the normal vector of the frame line 
50 at vertex P, and the normal vector of the frame line at vertex P 2 . 

[0154] Returning to Figure 20, in step S15, if it is decided that input unit 11 was operated not with additional 
operation but so as to end the input of the coordinates of vertices and the normal vectors of the frame lines at the 
vertices, one proceeds to step S16, and with data processing unit 12 the curved surface formed by the frame lines 
determined thus far (the curved surface that constitutes the three-dimensional shape) is determined. That is, if, for 
example, frame lines P 1 P 2 , P 3 P 4 , P 1 P 3 , P 2 P 4 are determined as described in Figure 22, then in step S16 curved 
surface S is determined, which is surrounded by frame lines P n P 2 , P3P4. P1P3. P2 P 4 as shown in Figure 24. 
[0155] Then one proceeds to step S17, and data processing unit 12 computes the frame line interpolation normal 
vector and curved surface interpolation normal vector for each vertex stored in splitting database 13. That is, data 
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processing unit 12 takes the normal vector of the frame line at each vertex stored in splitting database 13, as is, 
as the frame line interpolation vector for each respective vector. Therefore the frame line interpolation normal 
vector at a given vertex (as well as the normal vector of the frame line at the vertex), from what was explained in 
Figure 23, becomes the normal-direction vector in the specified plane in the case where the Bezier curve as a frame 
line (the Bezier curve determined as explained in Figure 23) is touched by the line that is the projection of the 

5 line segment that joins the vertex and another vertex onto a specified plane that includes the vertex. 

[0156] Also, in step S17, data processing unit 12 determines the normal vectors of the curved surface determined 
in step S16 at each vertex stored in splitting database 13, sets them to the curved surface interpolation normal 
vectors at the corresponding vertices, and supplies them to, and stores them in, splitting database 13. The curved 
surface interpolation normal vectors coincide with the normal vectors used in the case when shading of the polygons 

10 is done. 

[0157] Here, if in fine splitting processing the interpolated lines between vertices are determined using only 
the curved surface interpolation normal vectors among the frame line interpolation normal vectors and curved surface 
interpolation normal vectors, then, for example, as shown in Figure 25(A), the interpolated line will sometimes not 
coincide with the curved surface (frame line) determined in step S14 and will be bent. On the other hand, if the 
interpolated lines between vertices are determined using the frame line interpolation normal vectors, then, for 
15 example, as shown in Figure 25(B), a smooth interpolated line will be obtained that coincides with the curved surface 
(frame line) determined in step S14. 

[0158] In step S17, when data processing unit 12 determines the frame line interpolation normal vectors and 
curved surface interpolation normal vectors, one proceeds to step S18, and vector coalescence processing is done. 
[0159] That is, if there is a large discrepancy between the direction of the orthogonal projection of the line 

2Q segment .that joins one vertex with another vertex adjacent to it onto the plane that passes through the one vertex 
and is perpendicular to the curved surface interpolation normal vector, and the direction of the tangent at the one 
vertex of the curved surface (frame line) along the three-dimensional shape to be realized (the frame line direction), 
then, as stated above, the interpolated line will be bent and the size of this discrepancy is reflected in the 
difference between the frame line interpolation normal vector and the curved surface interpolation normal vector. 
[0160] On the other hand, the size of the aforesaid discrepancy is often zero (including cases m which it is 

25 almost zero) (where the size of the discrepancy is large is, for example, a case in which, as stated above, a circular 
cylinder or other body of revolution made by rotating a plane shape about ah axis of rotation, or a similar three- 
dimensional shape, is to be realized); in this case, the frame line interpolation normal vector and the curved 
surface interpolation normal vector coincide (roughly coincide). It is redundant to separate the frame line 
interpolation normal vector and the curved surface interpolation normal vector that thus coincide and separately make 
them into splitting polygon data. 

30 [0161] In order to reduce the volume of data in the splitting polygon data, in step S18 the frame line 
interpolation normal vector and the curved surface interpolation normal vector at the same vertex are compared, and 
if they coincide (roughly coincide), then vector coalescence processing is done, in which the frame line 
interpolation normal vector and the curved surface interpolation normal vector are combined into a single vector. 
Here, if the frame line interpolation normal vector and the curved surface interpolation normal vector coincide 
completely, then in step S18, for example, one or the other vector is selected, and this is made the result of the 
vector coalescence processing. And if the frame line interpolation normal vector and the curved surface interpolation 
normal vector coincide roughly, then in step S18, for example, their avenge value is determined, and this is made the 
result of the vector coalescence processing. The result of the vector coalescence processing is written in instead of 
the frame line interpolation normal vector and the curved surface interpolation normal vector that are stored in 
splitting database 13 and are the object of this vector coalescence processing. If the frame line interpolation 

40 normal vector and the curved surface interpolation normal vector at the same vector do not coincide, they are kept in 
the state in. which they are stored in splitting database 13. 

[0162] Once data processing unit 12, in step S18, performs vector coalescence processing on all the vertices 
stored in splitting database 13, one proceeds to S19, in which the splitting polygon data is composed based on the 
content stored in splitting database 13, and splitting polygon data generation processing is terminated. 
[0163] Figure 26 shows the format of the splitting polygon data composed in step S19. 
45 [0164] Splitting polygon data consists of, for example, I reference data items #1 through #l, followed by I 
polygon data items #1 through #l arranged in sequence, as shown in Figure 26(A). 

[0165] Here, polygon data item #i (i = 1, 2 I) is generated, for example in the splitting polygon data 

generation processing of Figure 20, every time a curved surface such as that shown in Figure 24 is made, for the 
quadrilateral polygons P,P 2 P 4 Pz that make up this curved surface S. Therefore Figure 26(A) shows the splitting 
50 polygon data for the case in which a three-dimensional shape consists of I polygons. 

[0166] As shown in Figure 26(B), polygon data item #i consists of the coordinates (px^py^pzj, (px2,py 2 ,pz 2 ), 
(P x 3.P v 3.pz 3 ), -•- of tne vertices that constitute its polygon #i, the normal vectors (nx^ny^nz^, (nx2,ny 2 ,nz 2 ) t 
(nx 3 ,ny 3 ,nz 3 ) that are frame line interpolation normal vectors or curved surface interpolation normal vectors at each 
vertex, and other data. Attached to the vertex coordinates and normal vectors arranged in polygon data item #i are 
indexes for specifying them. And in the embodiment of Figure 26(B), sequential numbers are actually attached to the 
vertex coordinates and normal vectors as indexes, but for the indexes it is also possible to allocate sequential 
numbers to the vertex coordinates and normal vectors in the sequence in which they are arranged, without writing the 
index into polygon data item #i. 
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[0167] Reference data item #i, which is data that is used when polygon data item #i is referenced, consists for 
example of the number of vertices as the number of vertices that constitute polygon #i and reference data on each 
vertex, as shown in Figure 26(C). Therefore if polygon #i has J vertices, J reference data items concerning vertices 

will be laid out. As shown in Figure 26(D), reference data on vertex #j (j = 1, 2 5) consists of the index of 

the coordinates of vertex #j, the indexes of frame line interpolation normal vectors A and B at the vertex, and the 
5 index of the curved surface interpolation normal vector at the vertex, arranged sequentially. 

[0168] If, for example, 1 is laid out as the index of the coordinates of vertex #j, then the coordinates (px^py^pz^ 
to which index "1" is assigned in polygon data item #i, which corresponds to reference data item #i, will be the 
coordinates of vertex #j. 

[0169] For example if, say, 1 is laid out as the index of frame line interpolation normal vector A, then the 
10 normal vector (nx 1 ,ny 1 ,nz 1 ) to which index "1" is assigned in polygon data item #i, which corresponds to reference 
data item #i, will be frame line interpolation normal vector A at vertex #j. 

[0170] And for example if, say, 2 is laid out as the index of frame line interpolation normal vector B, then the 
normal vector (nx 2 ,ny 2 ,nz 2 ) to which index "2" is assigned in polygon data item #i, which corresponds to reference 
data item #i, will be frame line interpolation normal vector B at vertex #j. 

[0171] And for example if, say, 3 is laid out as the index of the curved surface interpolation normal vector, 
1 then the normal vector (nX3.nV3.nZ3) to which index "3" is assigned in polygon data item #i, which corresponds to 
reference data item #i, will be the curved surface interpolation normal vector at vertex #j. 

[0172] The reason why there are two frame line interpolation normal vectors, vectors A and B, at one vertex #j, 
is as follows. For example at each vertex P n through P A of quadrilateral polygon P 1 P 2 P 4 P 3 that comprises curved 
surface S shown in Figure 24, which are generated in the aforementioned splitting polygon data generation processing, 
20 two curves (frame lines) of different direction intersect, but the normal vectors for these two curves are given as 
curved surface interpolation normal vectors. 

[0173] In the foregoing case, frame line interpolation normal vectors A, B and the curved surface interpolation 
normal vector are each given a different index, but in a case where in step S18 in Figure 20 frame line interpolation 
normal vectors A, B and the curved surface interpolation normal vector coincide and are coalesced into a single 
vector, each of the frame line interpolation normal vectors A, B and the curved surface interpolation normal vector 

25 is given an index allocated to their single coalesced vector. That is, if for example frame line interpolation normal 
vectors A, B and the curved surface interpolation normal vector are each represented by (nx^ny^nz^, then the index 
of each of the frame line interpolation normal vectors A, B and of the curved surface interpolation normal vector is 
set to 1, which is the index allocated to normal vector (nx^ny^nz^ (in this case, normal vector (nx^ny^nz^ is the 
result of vector coalescence processing (in step S18 in Figure 20) on frame line interpolation normal vectors A, B 

30 and on the curved surface interpolation normal vector). Also, in this case, only vector (nx^ny^nz^ is mapped to 
polygon data item #i as a normal vector. 

[0174] In the splitting polygon data generation processing in Figure 20, the producer causes the coordinates of 
the vertices and the normal vectors of the frame line at the vertices to be input, and then the three-dimensional 
shape is defined by determining the curves that will be the frame lines and causing the curves to intersect, but a 
three-dimensional shape can also be composed in the following way. 
35 [0175] First, one takes actual measurements for the three-dimensional shape to be realized, determines the 
coordinates of each vertex in three-dimensional space and the normal vectors of the three-dimensional shape at each 
vertex, that is, determines the curved surface interpolation normal vectors, and has these input into data processing 
unit 12 by the producer. Data processing unit 12 is made to determine and display the curves that will be the frame 
lines, taking the curved interpolation normal vectors to be the frame line interpolation normal vectors A, B for each 
of the two frame lines that intersect at a given vertex. Then, for the displayed frame lines that are bent (distorted) 
, one has the producer correct frame line interpolation normal vectors A, B that are equal to the curve interpolation 
normal vector in such a way that the frame lines become smooth. In this case, one may dispense with the processing of 
steps S17 and S18 in Figure 20. 

[0176] Next, splitting polygon data generation processing (Figure 20) is done by data provision device 1, and 
when splitting polygon data as shown in Figure 26 has been stored in splitting database 13, the splitting polygon 
45 data is read from splitting database 13 in splitting processing unit 14, and fine splitting processing is done. 

[0177] Referring to the flowchart in Figure 27, we describe the fine splitting processing performed on polygons 
in splitting processing unit 14. 

[0178] Here, for example a quadrilateral polygon P 1 P 2 P 4 P 3 as shown in Figure 28 is split into M or N parts 
horizontally or vertically, respectively, thereby making something that is composed of MxN quadrilateral subpolygons 
(here, for example, the direction of line segment P^ (or P 3 P 4 ) of quadrilateral polygon P 1 P 2 P 4 P 3 in Figure 28 is 
taken as the horizontal direction, and the direction of line segment P 1 P 3 (or P 2 P 4 ) is taken as the vertical direction). 
[0179] The curved surface interpolation vector at vertex Pi (i = 1, 2, 3, 4) of quadrilateral polygon P 1 P 2 P 4 P 3 is 
denoted by nj, the line frame interpolation normal vector for the horizontal frame line at vertex P } is denoted by A jt and 
the line frame interpolation normal vector for the vertical frame line is denoted by Bj. 

[0180] In this case, in fine splitting processing, first, in step S21, fine splitting processing of frame line P 1 P 2 is 
55 done. That is, in step S21, M-1 interpolated points P 12 are set between vertices P t and P 2 , and a curved surface 
interpolation normal vector n 12 is determined at each of these M-1 interpolated points P 12 . 

[0181] Then one proceeds to step S22, where splitting processing of frame line P 3 P 4 is done. That is, in step 
S22, M-1 interpolated points P34 are set between vertices P 3 and P 4 , and a curved surface interpolation normal vector n 
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34 is determined at each of these M-1 interpolated points P^. 

[0182] Thereafter, one proceeds in sequence to steps S23 and S24, where splitting processing of frame line 
P^P Z and splitting processing of frame line P 2 P 4 is done. That is, in step S23, N-1 interpolated points P 13 are set 
between vertex P t and vertex P 3 and a curved surface interpolation normal vector n 13 is determined at each of these 
N-1 interpolated points P 13 . And in step S24, N-1 interpolated points P 24 are set between vertex P 2 and vertex P 4 , and 
a curved surface interpolation normal vector n 24 is determined at each of these N-1 interpolated points P 24 . 
[0183] Then one proceeds to step S25, where splitting processing inside the polygon of quadrilateral polygon 
p i P 2 P 4 P 3 is done. That is, in step S25, N-1 interpolated points are set between each of the M-1 interpolated 
points P 12 and the corresponding one of the M-1 interpolated points P^, thus setting a total of (M-1)x(N-1) interpolated 
points P 1234 , and a curved surface interpolation normal vector n 1234 is determined at each of these (M- 1)x(N- 
1) interpolated points P 1234 . 

■ [0184] Thereafter, one proceeds to step S26, where quadrilateral polygon P^P^ is split into MxN 

quadrilateral subpolygons based on the interpolated points P 12 , P^, P 13 , P 24 , and P 1234 determined in steps S21 through 
S25, and fine splitting processing is terminated. 

[0185] For example, assuming now that quadrilateral polygon P 1 P 2 P 4 P 3 shown in Figure 28 is split into 2x2 
15 quadrilateral subpolygons (and therefore M-1=N-1=1), in step S21 of Figure 27, an interpolated line that coincides 
with frame line P^ 2 is determined by performing the control point computation processing of Figure 9 using the 
coordinates of vertices P 1 and P 2 and the frame line interpolation normal vectors A 1 and A;,. And in step S21, 
interpolated point P 12 , which is one point on interpolated line P 1 P 2 , is determined as shown in Figure 29, by 
substituting for example 0.5 for the parameter t in equation (1) of the Bezier curve that represents this interpolated line P 
,P 2 . Also, in step S21, curved surface interpolation normal vector n 12 at interpolated point P 12 is determined from 
curved surface interpolation normal vector n n or n 2 at vertex P 1 or P 2 , respectively, as explained in Figure 16. 
[0186] Likewise in step S22, the same processing as in step S21 is done on vertices P 3 and P 4 , thereby 
determining interpolated point P^, which is one point on interpolated line P 3 P 4 , and determining curved surface 
interpolation normal vector n^ at this interpolated point P^, as shown in Figure 29. 

[0187] In step S23, an interpolated line that coincides with frame line P 1 P 3 is determined by performing the 
25 control point computation processing of Figure 9 using the coordinates of vertices P, and P 3 and the frame line 
interpolation normal vectors B 1 and B 3 . In step S23, interpolated point P 13 , which is one point on interpolated line P^, 
is determined as shown in Figure 30, by substituting for example 0.5 for the parameter t in equation (1) of the 
Bezier curve that represents this interpolated line P 1 P 3 . Also, in step S23, curved surface interpolation normal 
vector n 13 at interpolated point P 13 is determined from curved surface interpolation normal vector n 1 or n 3 at 
30 vertex P 1 or P 3 , respectively, as explained in Figure 16. 

[0188] Likewise in step S24, the same processing as in step S23 is done on vertices P 2 and P 4 , thereby 
determining interpolated point P 24 , which is one point on interpolated line P 2 P 4 , and determining curved surface 
interpolation normal vector n 24 at this interpolated point P 24 , as shown in Figure 30. 

[0189] In step S25, interpolated lines are determined that interpolate between corresponding interpolation 
members of the interpolated points on interpolated line P 1 P 2 and the interpolated points on interpolated line P 3 P 4 , and 
on such an interpolated line, the same number of interpolated points are set as the interpolated points set on 
interpolated line P,P 3 (or interpolated line P 2 P 4 ). That is, in the present case, as shown in Figure 31, interpolated line P 
12 P 34- which interpolates between interpolated points P 12 and P^, is determined by performing the control point 
computation processing of Figure 9 using the coordinates of interpolated points P 12 and P^ and the curved surface 
interpolation normal vectors n 12 , n^. The interpolated point P 1234 , which is one point on interpolated line P^P^. is 
40 determined as shown in Figure 31, by substituting for example 0.5 for the parameter t in equation (1) of the Bezier 
curve that represents this interpolated line P^P^- Als °. curved surface interpolation normal vector n 1234 at 
interpolated point P 1234 is determined from curved surface interpolation normal vector n 12 or at interpolated 
point P 12 or P M , respectively, as explained in Figure 16. 

[0190] In step S26, quadrilateral polygon P 1 P 2 P 4 P 3 is split into 2x2 quadrilateral subpolygons based on the 
interpolated points P 12 , P^ P 13 , P 24 , and P 1234 determined in steps S21 through S25. That is, quadrilateral polygon . 
p i P 2 P 4 P 3 shown in Figure 28 is split into four quadrilateral subpolygons p iPi 2 p i234 P i3. P 12 P 2 P 24 P 1234« P 1234 P 24 P 4 P 34- 
and p 13 p i234 P 34 P 3. thereby realizing a three-dimensional shape that is smoother than in the case of just 
quadrilateral polygon PTP2P4P3- 

[0191] In the above case, in step S25, interpolated lines are determined that interpolate between corresponding 
interpolation members of the interpolated points on interpolated line P 1 P 2 and the interpolated points on interpolated 

50 line P 3 P 4 , and on such an interpolated line, the same number of interpolated points are set as the interpolated 
points set on interpolated line P t P 3 (or interpolated line P 2 P 4 ), but otherwise it suffices to determine interpolated 
lines that interpolate between corresponding interpolation members of the interpolated points on interpolated line 
P A P 3 and the interpolated points on interpolated line P 2 P 4 , and on such an interpolated line, the same number of 
interpolated points are set as the interpolated points set on interpolated line P n P 2 (or interpolated line P 3 P 4 ). 

55 [0192] That is, if for example quadrilateral polygon P 1 P 2 P 4 P 3 shown in Figure 28 is to be split into 2x2 
quadrilateral subpolygons, in step S25, as shown in Figure 33, interpolated line P 13 P 24 that interpolates between 
interpolated points P 13 and P 24 is determined by performing the control point computation processing of Figure 9 
using the coordinates of interpolated points P 13 and P 24 and the curved surface interpolation normal vectors 
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n 13 and n 24 . In step S25, interpolated point P 1324 , which is one point on interpolated line P 12 P 34. is determined by 
substituting for example 0.5 for the parameter t in equation (1) of the Bezier curve that represents this interpolated line P 
13 P 24 , and curved surface interpolation normal vector n 1324 at interpolated point P 1324 is determined from curved surface 
interpolation normal vector n 13 or n 24 at interpolated point P 13 or P 24 , respectively, as explained in Figure 16. 
5 [0193] In this case, quadrilateral polygon P 1 P 2 P 4 P 3 in Figure 28 is split into four quadrilateral subpolygons P^^P 

1324^13* ' 3 12^2^24' 3 1324' ^ 1324^24^4^34' an0< ^ 13^ 1324^^3' 

* [0194] Here it is possible in step S25 to determine both interpolated points P 1234 (Figure 31) and P 1324 (Figure 33) 
and set the final interpolated point to the point that is expressed by, say, the average value of their coordinates. 
In this case, the curved surface interpolation normal vector at the final interpolated point is set to, say, the 
avenge value of curved surface interpolation normal vectors n 1234 and n 1324 . 

10 [0195] The subpolygons obtained by the above fine splitting processing are supplied from splitting processing 
unit 14 to rendering unit 15 and are drawn by rendering processing being performed. That is, rendering unit 15 for 
example performs rendering on the subpolygons and converts them to the screen coordinate system. The shading of 
the subpolygons is done using the curved surface interpolation normal vector at each vertex. Rendering unit 15 
determines the final RGB values of each pixel that constitutes display unit 16, such as by calculating the texture 
addresses for texture mapping using the texture data stored in texture database 17, and outputs them to display unit 

15 16. In this way, the three-dimensional image consisting of the subpolygons is displayed on display unit 16. 

[0196] And if there are no problems in the three-dimensional image displayed on display unit 16, the producer 
operates input unit 11 so as to supply the stored content of splitting database 13 to transmission/recording device 
18. In response to this, the splitting polygon data stored in splitting database 13 is supplied to 
transmission/recording device 18. When it receives the splitting polygon data, transmission/recording device 18 reads 

20 the texture data from texture database 17, multiplexes it with the splitting polygon data, and transmits it via 
transmission medium 2 or records it on recording medium 3. 

[0197] If there is any problem with the three-dimensional image displayed on display unit 16, the producer 
corrects the splitting polygon data by operating input unit 11. 

[0198] Next, referring to the flowchart in Figure 34, we further describe the frame line splitting processing in 
steps S21 through S24 in Figure 27. Here one vertex that constitutes the polygon is denoted by P v and another vertex 
that is adjacent to this vertex P 1 is denoted by P 2 . Also, the frame line interpolation vector at vertex P t or P 2 for frame 
line P,P 2 between vertices P 1 and P 2 is denoted by A 1 or A^ respectively, and the curved surface interpolation 
normal vector at vertex P 1 or P 2 is denoted by n 1 or n 2 , respectively. 

[0199] In frame line splitting processing, first, in step S31, straight line (line segment) P 1 P 2 is determined, one 
proceeds to step S32, straight line P 1 P 2 is orthogonally projected onto the plane tat includes vertex P 1 or P 2 and is 
30 perpendicular to frame line interpolation normal vector A 1 or A^ respectively, the unit vector in the straight-line 
direction projected onto each plane is determined, and each is taken as the tangent vector at vertex P 1 or P 2l 
respectively. 

[0200] One then proceeds to step S33, which determines the angle 6 1 or 9 2 that straight line P 1 P 2 forms with the 
tangent vector at vertex P 1 or P 2 , respectively. Then one proceeds in sequence to steps S34 and S35, where a third- 
order Bezier curve is determined as the interpolation line that coincides with frame line P 1 P 2 , as in the case in Figure 9. 
[0201] That is, in step S34, based on angles 0, and 9 2 and the coordinates of vertices P 1 and P 2 , one determines 
control edge length or L 2 , which is the distance from control point P 1 or P 2 to another control point 
Q 1 or Q 2 respectively. And in step S35, control point or Q 2 is determined from control edge length or U,, 
respectively, and thereby a three-dimensional Bezier curve is specified as the interpolated line that coincides with 
frame line P 1 P 2 . 

40 [0202] Proceeding in sequence to steps S36 and S37, interpolated points P 12 are set on interpolated line P 1 P 2 , 
which is a Bezier curve, curved surface interpolation normal vectors n 12 at these interpolated points P 12 are determined, 
and frame line splitting processing is terminated. 

[0203] That is, in step S36, an interpolated point P 12 is determined by substituting a specified value into 
parameter t in equation (1) that expresses interpolated line P 1 P 2 , which is a Bezier curve. And in step S36, tangent 
45 vector s 12 at interpolated point P 12 of interpolated line P n P 2 is determined as explained in Figure 16, and vector 
nn 12 described in Figure 16 is determined by doing linear interpolation using curved surface interpolation normal 
vectors n 1 and n 2 . And in step S37, vector nn 12 is corrected by tangent vector s 12 as explained in Figure 16, and the 
result of the correction is determined as final curved surface interpolation normal vector n 12 at interpolated point P 12 . 
[0204] Next, referring to the flowchart in Figure 35, we further describe the splitting processing inside 

polygons in step S25 of Figure 27. Here, one interpolated point on the frame line obtained by frame line splitting 
processing is denoted by P v and the interpolated point on the frame line that is opposite this frame line and 
corresponds to interpolated point P 1 is denoted by P 2 . Also, in the frame line splitting processing for determining 
interpolated point P 1 or P 2 , the curved surface interpolation normal vector determined together with interpolated points P 
! and P 2 is denoted by n 1 or n 2 , respectively. 
[0205] In splitting processing of the interior of polygons, the same processing is done in steps 41 through S47 
55 as in the case of steps S31 through S37 in Figure 34 -except that in step S42 the tangent vector at interpolated 
point P 1 or P 2 is determined using not the frame line interpolation norma! vector but curved surface interpolation vector n 
t or n 2 , respectively - and the interpolated points on the Bezier curve as the interpolated line that interpolates 
between interpolated points P A and P 2 , and curved surface interpolation normal vector n 12 at these interpolated points 
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are determined. 

[0206] If, as above, a vertex has both a frame line interpolation normal vector and a curved surface 

interpolation normal vector, then an interpolated point that interpolates between vertices of the original polygon on 
which fine splitting processing is done is determined using the frame line interpolation normal vectors, and an 
interpolated point that interpolates between interpolated points is determined using the curved surface interpolation 
normal vectors. But if the bending of the interpolated line (frame line) as stated above is not a problem, then an 
interpolated point maybe determined using only the curved surface interpolation normal vectors, even if the vertices 
have both frame line interpolation normal vectors and curved surface interpolation normal vectors. 
[0207] With the aforesaid fine splitting processing, subpolygons tat constitute a smooth three-dimensional shape 
can be generated from splitting polygon data concerning rough polygons. 

10 [0208] That is, for example the cube shown in Figure 36 consists of six quadrilateral (square) polygons 
constituting its six faces, and if drawing is done without performing any fine splitting processing on these six 
quadrilateral polygons, what results is, for example, a cube as shown in Figure 37. In contrast to this, if each 
vertex of the six quadrilateral polygons is given as an interpolation vector (curved surface interpolation normal 
vector) a vector that extends radially from the center of the cube, and fine splitting processing is carried out, 
then what results is, for example, a sphere as shown in Figure 38. In Figure 38 (as in Figure 40 through Figure 42, 

15 which are discussed below), each quadrilateral polygon is split into 5x5 subpolygons. 

[0209] Furthermore, by changing the interpolation vectors given at each vertex of the six quadrilateral polygons 
from those shown in Figure 36 to, for example, ones that are tilted as shown in the side view in Figure 39, the six 
quadrilateral polygons, by fine splitting processing, are split into subpolygons that comprise a distorted sphere as 
indicated by the dotted line in this diagram. That is, by just changing the interpolation vectors assigned to the six 

2 0 quadrilateral polygons that constitute the cube, one can obtain a, so to speak, egg-shaped three-dimensional shape as 
shown in Figure 40 or Figure 41. 

[0210] Here the three-dimensional shapes shown in Figure 38, Figure 40, and Figure 41 can be realized by using 
as interpolation vectors only the curved surface interpolation normal vectors. 

[0211] Also, for example, a circular cylinder as shown in Figure 42 can be realized through fine splitting 
processing by assigning to the vertices of those of the six quadrilateral polygons comprising the cube shown in Figure 
25 36 that will constitute the side faces of the circular cylinder the normal vectors of these quadrilateral polygons as 
frame line interpolation normal vectors or curved surface interpolation normal vectors, assigning to the vertices of 
the quadrilateral polygons that will comprise the circle that is to be the base of the circular cylinder, as frame 
line interpolation normal vectors, normal vectors in a direction extending radially from the center of this circle, 
and assigning normal-direction vectors of (the surface of) this circle as curved surface interpolation normal vectors. 
[0212] Since, as described above, fine splitting processing makes it possible to generate subpolygons that 
constitute a smooth three-dimensional shape from splitting polygon data concerning rough polygons, the producer is 
given the ability to compose a complex three-dimensional shape even without setting detailed parameters concerning 
the three-dimensional shape. 

[021 3] Next, referring to the flowchart in Figure 43, the processing of user terminal 4 in Figure 3 will be described. 
[0214] With user terminal 4, reception/playback device 21 receives data transmitted via transmission medium 2 or 

35 plays back data recorded on recording medium 3, and among this data, the splitting polygon data is supplied to and 
recorded in splitting database 22, and the texture data is supplied to and recorded in texture database 27. 
[0215] The splitting polygon data recorded in splitting database 22 is read, for example in one-frame units, by 
geometry processing unit 23, and in step S51 of Fig. 43, geometry processing unit 23 performs geometry processing 
(such as coordinate transformations according to the viewpoint) on this splitting polygon data in response to 
operation by the user of input unit 28, and supplies the result to splitting processing unit 24. In step S52, 

40 splitting processing unit 24 performs fine splitting processing on the splitting polygon data in the same way as in 
splitting processing unit 14 of data provision device 1, and the resulting subpolygons are supplied to rendering unit 
25. In step S53, rendering unit 25 performs a perspective transformation (perspective projection transformation) on 
the subpolygons from splitting processing unit 14, and proceeds to step S54. In step S54, brightness calculation 
(shading (for example, Gouraud shading or Phong shading)) is done on the transformed data, and texture address 

45 calculation, etc. is done, thereby determining the RGB values of each pixel. In step S55, in rendering unit 25 the 
RGB values of each pixel are written to a frame buffer that is not shown in the diagram, and one returns to step S51 
to wait for splitting polygon data concerning the next frame to be read from splitting database 22. The three- 
dimensional image as RGB values written into the frame buffer is read out with the prescribed timing and is displayed 
on display unit 26. 

[0216] Therefore, with user terminal 4 too, as in the case of data provision device 1, subpolygons that 
50 constitute a smooth three-dimensional shape can be generated from splitting polygon data concerning rough 
polygons. 

[0217] Next, Figure 44 shows an example of the configuration if user terminal 4 is, say, a video game machine. 
And if user terminal 4 is a video game machine, in addition to data for displaying three-dimensional images, game 
programs (computer programs), etc. are also provided to user terminal 4 from data provision device 1 via transmission 
medium 2 or recording medium 3. 
55 [0218] This video game machine has two kinds of buses for exchanging data among the blocks, main bus 101 and 
sub bus 102; main bus 101 and sub bus 102 are connected via bus controller 116. 

[0219] Connected to main bus 101, besides bus controller 116, are, for example, main CPU (Central Processing 
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Unit) 111, which consists of subprocessors, etc., main memory 112, which for example consists of RAM (Random 
Access Memory), main DMAC (Direct Memory Access Controller) 113, MDEC (MPEG (Moving Picture Experts Group) 
Decoder) 114; and GPU (Graphic Processor Unit) 115. 

[0220] Connected to sub bus 102, besides bus controller 116, are GPU 115, sub CPU 121, which for example is 
configured in the same way as main CPU 111, sub memory 122, which for example is configured in the same way as 
5 main memory 112, sub DMAC 123, ROM (Read Only Memory) 124, which holds the operating system, etc., SPU 
(Sound Processing Unit) 125, ATM (Asynchronous Transmission Mode) communication unit 126, auxiliary memory unit 
127, and input device interface l/F 128. 

[0221] Here, data is exchanged at high speed by main bus 101 and at low speed by sub bus 102. That is, the high- 
speed performance of main bus 101 is assured by using sub bus 102 for data that can be exchanged at low speed. 

10 [0222] Bus controller 116 is made so as to disconnect main bus 101 and sub bus 102 and connect main bus 101 
and sub bus 102. If main bus 101 and sub bus 102 are disconnected, only devices connected to main bus 101 can be 
accessed from main bus 101, and only devices connected to sub bus 102 can be accessed from sub bus 102, but if sub 
bus 102 is connected to main bus 101, any device can be accessed from either main bus 101 or sub bus 102. And in 
the initial state, such as immediately after the power to the device has been turned on, bus controller 116 is in 
open state (the state in which main bus 101 and sub bus 102 are connected). 

15 [0223] Main CPU 111 performs various processing in accordance with programs stored in main memory 112. That 
is, main CPU 111, for example when the device is activated, reads via bus controller 116 the booting program from 
ROM 124 (connected to sub bus 102), which is on sub bus 102, and executes it. In this way, main CPU 111 causes the 
application programs (here, the game programs and programs . for performing the aforementioned fine splitting 
processing, etc.) and necessary data to be loaded from auxiliary memory device 127 into main memory 112 and sub 

2Q memory 122. Then main CPU 111 executes the programs it has thus caused to be loaded into main memory 112. 

[0224] Main CPU 111 includes a built-in GTE (Geometry Transfer Engine) 117; this GTE 117 has for example a 
parallel operation mechanism which executes multiple operations in parallel, and in accordance with requests from 
main CPU 111 performs high-speed arithmetic processing for such geometry processing as coordinate 
system transformations, etc. Thus, by carrying out processing (geometry processing) in accordance with requests 
from main CPU 111, GTE 117 generates and supplies to main CPU 111 the data for the polygons that constitute the 

25 three-dimensional image to be displayed. When main CPU 111 receives the polygon data from GTE 117, it transfers it 
to GPU 115 via main bus 101. 

[0225] Main CPU 111 also includes a built-in cache memory 119; processing can be speeded up by accessing this 
cache memory 119 instead of accessing main memory 112. 

[0226] As described above, main memory 112, besides storing programs, also stores data, etc. that is necessary 
for processing by main CPU 111. Main DMAC 1 13 controls DMA transfers to devices on main bus 101. However, when 
bus controller 116 is in open state, main DMAC 113 also controls devices on sub bus 102. MDEC 1 14, which is an I/O 
device that can operate in parallel with main CPU 111, functions as an image expansion engine. That is, MDEC 114 
decodes image data which was compressed by MPEG encoding. 

[0227] GPU 115 functions as a rendering processor. That is, GPU 115 receives data/including splitting polygon 
data, transmitted from main CPU 111 and splits it into subpolygons by performing fine splitting processing. Also GPU 

35 115, by performing perspective projection transformations on the subpolygons, converts it to data in a two- 
dimensional plane (screen coordinate system), and computes and writes (draws) to graphic memory 118 the pixel data 
that constitutes the polygons based on, for example, color data for the vertices of the polygons (although not stated 
above, color data is also included in the splitting polygon data) and Z values that indicate their depth (depth from 
the viewpoint). Also, GPU 115 reads out the pixel data that has been written into graphic memory 118 and outputs it 
as a video signal. In addition, GPU 115, as necessary, receives splitting polygon data also from main DMAC 113 or 

40 devices on sub bus 102 and performs similar processing in accordance with the data. 

[0228] Graphic memory 118 consists of, for example, DRAM, and has frame memory 141, Z buffer 142, and 
texture memory 143, as shown in Figure 45. Frame memory 141 stores the pixel data to be displayed on the screen, for 
example the portion for one frame. Z buffer 142 stores the Z value of the polygon that is nearest to the viewer in 
the image to be displayed on screen; it has enough memory capacity to store, for example, the Z values for one frame. 
Texture memory 143 stores data on the texture to be attached to the polygons. 

45 [0229] GPU 115 performs processing using frame memory 141, Z buffer 142, and texture memory 143. That is, 
GPU 115 causes the Z value of the subpolygon constituting the three-dimensional image that is nearest to the viewer 
to be stored, and based on the values stored in this Z buffer 142, it is decided whether to draw the pixel data (RGB 
values) to frame buffer 141. If the pixel data is to be drawn, texture data is read from texture memory 143, and this 
data is used to determine the pixel data to be drawn, and drawing is done to frame memory 141. 

50 [0230] Returning to Figure 44, sub CPU 121 performs various processing by reading and executing programs 
stored in sub memory 122. Stored in sub memory 122, as in main memory 112, are programs and the required data. 
Sub DMAC 123 controls DMA transfers to devices on sub bus 102. Also, sub DMAC 123 acquires bus rights only when 
bus controller 116 is in closed state (when main bus 101 and sub bus 102 are disconnected). ROM 124, as described 
above, stores the booting program and the operating system, etc. Also stored in ROM 124 are programs for both main 
CPU 111 and sub CPU 121. ROM 124 here has a slow access speed, and therefore it is on sub bus 102. 

55 [0231] SPU 125 receives packets transmitted from sub CPU 121 or sub DMAC 123 and reads audio data from 
sound memory 129 according to the sound commands laid out in these packets. Then SPU 125 outputs the read-out 
audio data to a speaker not shown. ATM communication unit 126 performs control (ATM communication control) of the 
communication that is done via, for example, transmission medium 2. In this way a video game machine user can 
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compete with other video game machine users by exchanging data either directly or via data provision device 1, a 
server on the Internet, or a so-called personal computer communications center. 

[0232] Auxiliary memory device 127 plays back information (programs, data) stored on recording medium 3 by, for 
example, a disk drive. Input device interface 128 consists of control pad 128A for giving various input and interface, 
and 128B or 128C, etc. for receiving external input such as images or audio played pack by other devices; it outputs 
to sub bus 102 signals that respond to input from outside. Sound memory 129 stores audio data. 

[0233] In user terminal 4 in Figure 3, reception/playback device 21 corresponds to ATM communication unit 126 
and auxiliary memory device 127 of Figure 44, splitting database 22 corresponds to main memory 112 of Figure 44 
geometry processing unit 23 corresponds to GTE 117 in Figure 44, splitting processing unit 24 and rendering unit 25 
correspond to GPU 115 in Figure 44, texture database 27 corresponds to texture memory 143 in Figure 45 and input 
unit 28 corresponds to control pad 128A in Figure 44. 

[0234] In a game machine configured as described above, when the power to the device is turned on, by the 
booting program being read from ROM 124 and executed in main CPU 111, programs and data are read by ATM 
communication unit 126 via transmission medium 2, or programs and data are read by auxiliary memory device 127 via 
recording medium 3, and are expanded into main memory 112 and sub memory 122. In main CPU 111 or sub CPU 121, 
respectively, the program expanded into main memory 112 or sub memory 122 is executed, thereby playing back the 
game images (here assumed to be moving images) and sound. 

[0235] That is, for example, in main CPU 111 geometry processing is done on the splitting polygon data stored in 
main memory 112, and is supplied to GPU 115 via main bus 101. 

[0236] Upon receiving splitting polygon data from main CPU 111, GPU 115 splits it into subpolygons by performing 
fine splitting processing. GPU 115 also performs a perspective transformation on the subpolygons, and draws the 
transformed subpolygons to frame memory 141 using 2 buffer 142. The results of drawing to frame memory 141 are 
appropriately read in GPU 115 and output as a video signal. In this way, three-dimensional images for the game are 
displayed on, for example, display unit 26 (Figure 3) as a two-dimensional output device. 

[0237] Meanwhile, in sub CPU 121, sound commands that direct the generation of audio are generated in 
accordance with the data stored in sub memory 122. These sound commands are packetized and supplied to SPU 125 
via sub bus 102. SPU 125 reads audio data from sound memory 129 and outputs it in accordance with the sound 
commands from sub CPU 121. In this way, background music for the game and other sounds are output. 
[0238] As described above, interpolated lines that interpolate between one vertex and another are determined 
from the coordinates of the vertices of a polygon and interpolation vectors at the vertices, and interpolated points, 
on the interpolated lines are determined as vertices of subpolygons, so it is possible to realize a smooth three- 
dimensional shape just by given data on polygons that are to some extent rough. 

[0239] Since a smooth three-dimensional shape can be realized with data concerning rough polygons, that is, with 
a small amount of data, data can be efficiently stored and transmitted if three-dimensional images are to be provided 
on, for example, the World Wide Web (WWW), which has been constructed on the Internet. That is, the splitting polygon 
data can be provided to user terminal 4 using a relatively small-capacity transmission medium 2 or recording medium 

[0240] From the standpoint of processing efficiency in, for example, video game machines or other graphic 
systems in which real-time display of three-dimensional images is important, the processing of polygons can be 
minimized by finely displaying three-dimensional shapes that are near to the viewpoint and coarsely displaying three- 
dimensional shapes that are far from the viewpoint. When doing so, the level of fineness (coarseness) of the three- 
dimensional shape, indicating how finely (or coarsely) the three-dimensional shape is to be made, is known as its 
level of detail (LOD), and three-dimensional shapes of the appropriate fineness (coarseness) can be displayed by 
determining according to the level of detail the number of partitionings of polygons when fine splitting processing 
is to be done. 

[0241] If a tree-dimensional shape composed of polygons is to be enlarged, the coarsening of the three- 
dimensional shape due to its enlargement can be prevented by doing fine partitioning and splitting the polygons into 
a number of subpolygons that depends on the enlargement ratio. That is, in this case, a three-dimensional shape of 
fixed smoothness can be presented regardless of the enlargement ratio. 

[0242] Also, because the splitting polygon data obtained by splitting polygon data generation processing 
includes the coordinates of the vertices of the polygons and the normal vectors at each polygon that are 
conventionally used for display of three-dimensional images (the curved surface interpolation normal vector 
conventionally coincides with the normal vector assigned to a vertex), this data can be handled even on an existing 
low-speed video game machine or other graphics system, and three-dimensional shapes can be displayed, although 
they will be coarse. 

[0243] Since the quantity of splitting polygon data is small, the amount of calculation in geometry processing 
and the like can be kept small by making sure that geometry processing for deformation or rotation of a three- 
dimensional shape, as well as the processing up to just before division by the Z value for perspective transformation 
(perspective division), are done prior to doing fine splitting processing, and by carrying out division by the Z 
value for perspective transformation on the subpolygons that are obtained after fine splitting processing. 
[0244] Also, in this embodiment it is considered ideal for an interpolated line to be equal to the arc of a 
circle or ellipse that passes through the two points interpolated by the interpolated line, and because such 
interpolated lines are determined, polygons that constitute a sphere, body of revolution, or similar shape can be 
represented with a smaller quantity of data than, for example, the case in which a sphere, body of revolution, or 
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similar shape is represented by spline curves or Bezier curves. 

[0245] The foregoing discussion concerns data provision systems or video game machines to which this invention 
applies, but this invention also is applicable to devices that perform computer graphics processing, such as 
effectors that give special effects to images, or CAD. Moreover, this invention is also applicable to, for example, a 
recording and playback device or transmission device that encodes natural images taken with a video camera and 
records and plays back or transmits and receives. That is, splitting polygon data generation processing can be 
applied to encoding processing so as to represent with polygons a natural image taken by a video camera or similar 
device, and fine splitting processing can be applied to decoding processing in which splitting polygon data obtained 
by such encoding is decoded into the original natural image. 

[0246] This invention is applicable to drawing either moving images or still images. 
10 [0247] This embodiment deals with three-dimensional graphics, but this invention is also applicable to, for 
example, two-dimensional graphics as well. That is, the present invention makes it easy to draw circles and ellipses 
just by prescribing, for example, a few points (at least two) by which an arc of a circle or ellipse can be formed, 
along with interpolation vectors at these points. Since the curvature of curves obtained in this way varies smoothly 
as is evident from Figure 10 through Figure 13, it is possible to obtain curves that vary smoothly. 

[0248] The number of partitions of polygons by fine splitting processing, besides being determined according to 
15 the level of detail or the enlargement ratio as discussed above, can be determined, for example, according to the 
processing capacity of the hardware that performs the fine splitting processing, or randomly using a random number. 
If the number of partitions of polygons is determined according to the processing capacity of the hardware that 
performs the fine splitting processing, one can display a three-dimensional shape of a smoothness appropriate to its 
processing capacity. If the number of partitions of polygons is determined randomly, the pattern that appears on the 
surface of a three-dimensional shape (the pattern composed by the boundary lines between polygons) can be varied 
randomly. 

[0249] Also, in this embodiment it is considered ideal for an interpolated line to be equal to the arc of a 
circle or ellipse that passes through the two points interpolated by the interpolated line, but an interpolated line 
is not limited to this. That is, an interpolated line may be determined so as to minimize the square error with the 
curve, (frame line) along the three-dimensional shape to be realized, that passes through the two points that the 
25 interpolated line interpolates between. 

[0250] In this embodiment, cosG' is approximated as shown in equation (10), but cos9' may also be determined 
accurately, without performing such an approximation. Also, in this embodiment the determination is made by 
calculating the control edge length ratios L/K and L/K of the third-order Bezier curve from 0 1 and 9 2 , but in order to 
speed up this calculation, one may first prepare a correspondence table that discretizes from (G 1( G 2 ) to (L-/K U>/K) 
and determine L/K, L^K using this correspondence table. ' 
[0251] Also, this embodiment adopts third-order Bezier curves as interpolated lines, but the interpolated lines 
may be Bezier curves of order other than three, or parametric curves other than Bezier curves. 

[0252] If the three-dimensional shape composed by subpolygons obtained by fine splitting processing is allowed 
to be an arbitrary shape, then it suffices to have only curved surface interpolation normal vectors as the 
interpolation vectors, with no need for frame line interpolation normal vectors. 
35 [0253] Also, this embodiment adopts normal vectors of frame lines as vectors that express the direction. of the 
frame line at a vertex, but as vectors that express the direction of the frame line at a vertex one may also adopt 
tangent vectors of the frame line, as stated above. But because this tangent vector differs in its orientation by 
just 90 degrees from the normal vector of the frame line, it often differs from the curved surface interpolation 
normal vector as well, so in step S18 in Figure 20 they will often not be coalesced into a single vector thus 
increasing the quantity of data in the splitting polygon data. 

[0254] A computer program for performing the above-described fine splitting processing can be provided, along 
with the splitting polygon data, to user terminal 4 via transmission medium 2 or recording medium 3. Similarly a 
computer program for performing fine splitting processing or splitting polygon data generation processing can be 
provided to data provision device 1 via optical disk, magneto-optical disk, or other recording medium or maybe 
provided via Internet, satellite circuit, or other transmission medium. 
45 [0255] Splitting polygon data generation processing or fine splitting processing, besides being done by having a 
processor execute a computer program, may be done on dedicated hardware. 

[0256] In this embodiment, the three-dimensional image is displayed on display unit 16 (display unit 26), which 
is a CRT, liquid crystal display, or the like, but this invention also applies to cases in which, for example the 
three-dimensional image is printed by a printer (two-dimensional output device). 
5Q [0257] In this embodiment, the three-dimensional image is displayed on display unit 16 (display unit 26), which 
is a CRT, liquid crystal display, or the like, but this invention also applies to cases in which, for example, the 
three-dimensional image is printed by a printer (two-dimensional output device). 

[0258] According to the image processing device as claimed in claim 1, the image processing method as claimed in 
claim 25 and the program distribution medium as claimed in claim 49, interpolated lines which are lines that 
interpolate between two vertices are determined from interpolation vectors used for determining lines that 
55 interpolate between a given vertex and another vertex in the vertices of a unit graphic form, and from the 
coordinates of the vertices, and interpolated points which are points on interpolated lines are" determined as 
vertices of sub-unit graphic forms. Therefore, for example, sub-unit graphic forms that constitute a smooth shape can 
be obtained from rough unit graphic forms. 
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[0259] According to the image processing device as claimed in claim 74, the image processing method as claimed 
in claim 91 and the program distribution medium as claimed in claim 108, interpolation vectors are generated which 
are used for determining interpolated lines that are lines which interpolate between a given vertex and another 
vertex in the vertices of a unit graphic form input by an operation means being operated. Therefore, for example, 
smooth shapes can be constituted by using these interpolation vectors. 

[0260] According to the data distribution medium as claimed in claim 125, there are provided at least, as data 
concerning the image, the coordinates of the vertices and interpolation vectors at the vertices that are obtained by 
generating interpolation vectors used for determining interpolated lines that are lines that interpolate between a 
given vertex and another vertex in the vertices of a unit graphic form if the unit graphic form is input. Therefore, 
for example, smooth shapes can be constituted by using these interpolation vectors and the coordinates of the ' 
vertices. 

[0261] According to the image processing device as claimed in claim 133, interpolation vectors are generated 
which are used for determining interpolated lines which are lines that interpolate between a given vector and another 
vector in the vertices of a unit graphic form input by an operation means being operated. The interpolated lines are 
determined from the coordinates of the vertices and the interpolation vectors of the unit graphic forms, and the 
interpolated points that are points on interpolated lines are determined as sub-unit graphic forms. Therefore, for 
example, sub-unit graphic forms that constitute smooth shapes can be obtained from rough unit graphic forms. 

Claims 

1. An image processing device which by processing an image defined by a combination of unit graphic forms splits 
said-unit graphic forms into multiple sub-unit graphic forms, 

the image processing device comprising: 

an interpolated line computation means for determining an interpolated line which is the line that 
interpolates a space between two vertices from an interpolation vector used for determining a line that 
interpolates a space between a given vertex and another vertex of vertices of said unit graphic forms and 
from coordinates of said vertices; and 

an interpolated point computation means for determining as vertices of said sub-unit graphic forms, 
interpolated points which are points on said interpolated line. 



2. The image processing device as described in claim 1 wherein: 

if a unit graphic form has first through fourth vertices, a line segment which joins first and second 
vertices thereof and a line segment that joins third and fourth vertices thereof lie opposite each other, 
and a line segment which joins said first and third vertices and a line segment that joins said second and 
fourth vertices lie opposite each other; 

said interpolated line computation means determines a first interpolated line which interpolates a space 
between said first and second vertices, a second interpolated line which interpolates said third and fourth 
vertices, a third interpolated line which interpolates a space between said first and third vertices, and a 
fourth interpolated line which interpolates said second and fourth vertices, and also determines a fifth 
interpolated line which interpolates a space between an interpolated point on said first interpolated line 
and an interpolated point on said second interpolated line; and 

said interpolated point computation means determines interpolated points on said first through fifth 
interpolated lines as vertices of said sub-unit graphic forms. 



3. The image processing device as described in claim 2, and further comprising: 

an interpolation vector computation means for determining said interpolation vectors at interpolated points 
on said first interpolated line from said interpolation vectors at said first and second vertices and 
determining said interpolation vectors at interpolated points on said second interpolated line from said 
interpolation vectors at said third and fourth vertices; wherein 

said interpolated line computation means determines said fifth interpolated line from said interpolation 
vectors at interpolated points on said first and second interpolated lines and from coordinates of the 
interpolated points. 



4. 



The image processing device as described in claim 3, wherein 
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said interpolation vectors at first and second vertices of said unit graphic forms are normal-direction 
normal vectors of a shape to be produced by said unit graphic forms. 

The image processing device as described in claim 3, wherein 

said interpolation vectors at said first through fourth vertices of said unit graphic forms are vectors 
which define a direction at said first through fourth vertices of each said interpolated line which passes 
through said first through fourth vertices, respectively. 

The image processing device as described in claim 4, wherein 

said interpolation vectors at said first through fourth vertices of said unit graphic forms further include, 
in addition to said normal vectors, interpolated line direction vectors which define a direction at said 
first through fourth vertices of each said interpolated line which passes through said first through fourth 
vertices, respectively. 

The image processing device as described in claim 6, wherein 

said interpolated line computation means determines said first through fourth interpolated lines using said 
interpolated line direction vectors, and 

said interpolation vector computation means determines said interpolation vectors at interpolated points on 
said first and second interpolated lines using said normal vectors. 

The image processing device as described in claim 2, wherein 

any one set of vertices among said first and second vertices, said third and fourth vertices, said first and 
third vertices, or said second and fourth vertices is the same set of vertices. 



The image processing device as described in claim 1 , wherein 

said interpolation vectors at vertices of said unit graphic forms are normal-direction normal vectors of a 
shape to be produced by said unit graphic forms. 

The image processing device as described in claim 9, wherein 

said interpolation vectors at the vertices of said unit graphic forms further include, in addition to said 
normal vectors, vectors which define a direction of said interpolated lines at said vertices. 

The image processing device as described in claim 1, 

said interpolation vectors at the vertices of said unit graphic forms are interpolated line direction 
vectors which define directions of said interpolated lines at said vertices. 

The image processing device as described in claim 1 1 , wherein 

if said interpolated line is touched by a line onto which is projected a line segment which joins said 
vertex and another vertex in a prescribed plane which includes said vertex, said interpolated line direction 
vectors are normal-direction vectors in said prescribed plane. 

The image processing device as described in claim 1 1 wherein 

said interpolated line direction vectors are vectors which define a tangent direction of said interpolated 
lines at said vertices. 



The image processing device as described in claim 1 and further comprising: 



10 



EP 0 996 094 A1 

an interpolation vector computation means for determining from interpolation vectors at said vertices, an 
interpolation vector to be used for determining the line which interpolates the space between a given 
interpolated point and another interpolated point of said interpolated points. 

15. The image processing device as described in claim 14, wherein 

when a ratio of values corresponding to a distance from said interpolated point between one vertex and 
another vertex to one of said one vertex and the other vertex, respectively, is denoted by t:1-t, 

said interpolation vector computation means determines as the interpolation vector at said interpolated 
point the result corresponding to the sum of (1-t) times the interpolation vector at said one vertex plus t 
times the interpolation vector at said other vertex. 

i5 16. The image processing device as described in claim 15, and further comprising: 

a correction means for correcting the interpolation vector at said interpolated point determined by said 
interpolation vector computation means. 

20 17. The image processing device as described in claim 16, wherein said correction means determines the vector 
product of the interpolation vector at said interpolated point determined by said interpolation vector 
computation means and a tangent-direction tangent vector of said interpolated line at said interpolated point, 
determines the vector product of said vector product and said tangent vector, and takes a resulting vector as a 
post-correction interpolation vector at said interpolated point. 



25 



30 



35 



55 



18. The image processing device as described in claim 17, wherein said image is a three-dimensional image, and the 
image processing device further comprises a rendering means for rendering said sub-unit graphic forms. 

19. The image processing device as described in claim 11, wherein said rendering means performs shading based on 
said post-correction interpolation vector. 

20. The image processing device as described in claim 11, wherein said interpolated line is a Bezier curve. 

21. The image processing device as described in claim 20, wherein: 

said image is a three-dimensional image; and 
said interpolated line computation means includes: 



an angle computation means for determining a first or second angle formed by a straight line which joins one 
vertex and another vertex interpolated by said interpolated line, which is said Bezier curve, and each 
projection of the straight line onto a plane perpendicular to the interpolation vector at said one vertex or 
40 - other vertex, which is a plane that includes said one vertex or other vertex, 

a distance computation means for determining, based on said first and second angles, a first or second 
control edge length, which is a distance from said one vertex or other vertex to a first or second control 
point of said Bezier curve, and 

45 a Bezier curve computation means for determining said Bezier curve as the interpolated line which 

interpolates the space between said one vertex and other vertex by determining, based on said first or 
second control edge length, each said first and second control point. 

5Q 22. The image processing device as described in claim 1 , wherein 

if the coordinates of the vertices of said unit graphic forms and the interpolation vectors are recorded on 
a recording medium, the image processing device further comprises a playback means for playing back from 
the recording medium the coordinates of said vertices and the interpolation vectors. 



23. The image processing device as described in claim 1 , wherein 

if the coordinates of the vertices of said unit graphic forms and the interpolation vectors are transmitted 
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via a transmission route, the image processing device further comprises a reception means for receiving the 
coordinates of said vertices and the interpolation vectors transmitted via the transmission route. 



24. The image processing device as described in claim 1, wherein 

said image is a three-dimensional image, and the image processing device further comprising: 
an operation means which is operated when a prescribed input is given; 

a geometry processing means for reading data concerning said unit graphic forms from a recording medium 
and performing with respect to the data, geometry processing that corresponds to input from said operation 
means, 

a conversion means for converting said sub-unit graphic forms obtained by splitting said unit graphic forms ' 
resulting after said geometry processing into ones in the coordinate system of a 
two-dimensional output device, and 

a rendering means for rendering said sub-unit graphic forms converted by said conversion means. 



25. An image processing method for an image processing device which by processing an image defined by a 
combination of unit graphic forms, splits said unit graphic forms into multiple sub-unit graphic forms, 

the image processing method comprising: 

an interpolated line computation step of determining an interpolated line which is a line that interpolates 
a space between two vertices from an interpolation vector used for determining a line that interpolates a 
space between a given vertex and another vertex of vertices of said unit graphic forms and from coordinates 
of said vertices; and 

an interpolated point computation step of determining, as the vertices of said sub-unit graphic forms, 
interpolated points which are points on said interpolated line. 



26. The image processing method as described in claim 25, wherein 

if a unit graphic form has first through fourth vertices, a line segment which joins first and second 
vertices thereof and a line segment that joins third and fourth vertices thereof lie opposite each other, 
and a line segment that joins said first and third vertices and a line segment that joins said second and 
fourth vertices lie opposite each other, 

said interpolated line computation step determines a first interpolated line that interpolates a space 
between said first and second vertices, a second interpolated line that interpolates said third and fourth 
vertices, a third interpolated line that interpolates the space between said first and third vertices, and a 
fourth interpolated line that interpolates said second and fourth vertices, and also determines a fifth 
interpolated line that interpolates a space between an interpolated point on said first interpolated line 
and an interpolated point on said second interpolated line, and 

said interpolated point computation step determines the interpolated points on said first through fifth 
interpolated lines as vertices of said sub-unit graphic forms. 



27. The image processing method as described in claim 26 and further comprising: 

an interpolation vector computation step of determining said interpolation vector at interpolated points on 
said first interpolated line from said interpolation vector at said first and second vertices and 
determining said interpolation vector at interpolated points on said second interpolated line from said 
interpolation vector at said third and fourth vertices, and wherein 

said interpolated line computation step determines said fifth interpolated line from said interpolation 
vector at interpolated points on said first and second interpolated lines and from coordinates of the 
interpolated points. 



28. The image processing method as described in claim 27, wherein: 
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said interpolation vectors at said first through fourth vertices of said unit graphic forms are normal- 
direction normal vectors of a shape to be produced by said unit graphic forms. 

29. The image processing method as described in claim 27, wherein: 

said interpolation vectors at said first through fourth vertices of said unit graphic forms are vectors 
which define the direction at said first through fourth vertices of each said interpolated line which passes 
through first through fourth vertices, respectively. 

30. The image processing method as described in claim 28, wherein: 



said interpolation vectors at said first through fourth vertices of said unit graphic forms further include, 
in addition to said normal vectors, interpolated line direction vectors which define a direction at said 
15 fir st through fourth vertices of each said interpolated line that passes through said first through fourth 

vertices, respectively. 

31. The image processing method as described in claim 30, wherein: 

20 said interpolated line computation step determines said first trough fourth interpolated lines using said 

interpolated line direction vectors, and 

said interpolation vector computation step determines said interpolation vectors at interpolated points on 
said first and second interpolated lines using said normal vectors. 



32. The image processing method as described in claim 26, wherein: 

any one set of vertices among said first and second vertices, said third and fourth vertices, said first and 
third vertices, or said second and fourth vertices are the same vertices. 



33. The image processing method as described in claim 25, wherein: 

said interpolation vectors at vertices of said unit graphic forms are normal-direction normal vectors of the 
. shape to be realized by said unit graphic forms. 

34. The image processing method as described in claim 33, wherein: 

said interpolation vectors at the vertices of said unit graphic forms further include, in addition to said 
normal vectors, vectors which define directions of said interpolated lines at said vertices. 

35. The image processing method as described in claim 25, wherein: 

said interpolation vectors at the vertices of said unit graphic forms are interpolated line direction 
vectors which define directions of said interpolated lines at said vertices. 

36. The image processing method as described in claim 35, wherein 

if, in a prescribed plane that includes said vertices, said interpolated line is touched by a line onto 
50 which is projected a line segment that joins a given vertex and another vertex, said interpolated line 

direction vectors are normal-direction vectors in said prescribed plane. 

37. The image processing method as described in claim 35, wherein 

55 said interpolated line direction vectors are vectors that express the tangent direction of said interpolated 

lines at said vertices. 
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38. The image processing method as described in claim 25, and further comprising: 

an interpolation vector computation step of determining, from interpolation vectors at said vertices, the 
interpolation vector to be used for determining a line that interpolates the space between a given 
interpolated point and another interpolated point in said interpolated points. 

39. The image processing method as described in claim 38, wherein 

when the ratio of values corresponding to a distance from said interpolated point between one vertex and 
another vertex to said one vertex or to the other vertex, respectively, is denoted by t:1-t, 

said interpolation vector computation step determines as the interpolation vector at said interpolated point 
a result corresponding to the sum of (1-t) times the interpolation vector at said one vertex plus t times 
the interpolation vector at said other vertex. 

40. The image processing method as described in claim 39, and further comprising: 

a correction step of correcting the interpolation vector at said interpolated point determined by said 
interpolation vector computation step. 

41. The image processing method as described in claim 40, wherein 

said correction step 

determines a vector product of the interpolation vector at said interpolated point determined by said 
interpolation vector computation step and a tangent-direction tangent vector of said interpolated line at 
said interpolated point, 



determines the vector product of said vector product and said tangent vector, and 
30 takes the resulting vector as a post-correction interpolation vector at said interpolated point. 

42. The image processing method as described in claim 41 , wherein 

said image is a three-dimensional image, and further comprising 
a rendering step of rendering said sub-unit graphic forms. 



43. The image processing method as described in claim 42, wherein 

40 said rendering step performs shading based on said post-correction interpolation vector. 

44. The image processing method as described in claim 25, wherein 
said interpolated line is a Bezier curve. 



45. The image processing method as described in claim 44, wherein 
said image is a three-dimensional image, and wherein 
said interpolated line computation step includes: 



an angle computation step of determining a first or second angle formed by a straight line that joins one 
vertex and another vertex interpolated by said interpolated line, which is said Bezier curve, and each 
projection of the straight line onto a plane perpendicular to the interpolation vector at said one vertex or 
55 other vertex, which is a plane that includes said one vertex or other vertex, 

a distance computation step of determining, based on said first and second angles, a first or second control 
edge length, which is the distance from said one vertex or other vertex to a first or second control point 
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of said Bezier curve, and 

a Bezier curve computation step of determining said Bezier curve as the interpolated line that interpolates 
the space between said one vertex and other vertex by determining, based on said first or second control 
edge length, each said first and second control points. 

46. The image processing method as described in claim 25, wherein 

if the coordinates of the vertices of said unit graphic forms and the interpolation vectors are recorded on 
10 a recording medium, the image processing method further comprises a playback step of playing back from the 

recording medium the coordinates of said vertices and the interpolation vectors. 

47. The image processing method as described in claim 25, wherein 

15 if the coordinates of the vertices of said unit graphic forms and the interpolation vectors are transmitted 

via a transmission route, the image processing method further comprises a reception step of receiving the 
coordinates of said vertices and the interpolation vectors transmitted via the transmission route. 

48. The image processing method as described in claim 25, wherein 

20 

said image is a three-dimensional image, and 

said image processing device includes an operation means which is operated when a prescribed input is given, 
and 

25 the image processing method further comprising: 

a geometry processing step of reading data concerning said unit graphic forms from a recording medium and 
performing with respect to the data, geometry processing that corresponds to input from said operation means, 

30 a conversion step of converting said sub-unit graphic forms obtained by splitting said unit graphic forms 

resulting after said geometry processing into ones in the coordinate system of a two-dimensional output 
device, and 

a rendering step of rendering said sub-unit graphic forms converted by said conversion step. 

35 

49. A program distribution medium for providing a computer program to cause a computer to do processing that, by 
processing an image defined by a combination of unit graphic forms, splits said unit graphic forms into multiple 
sub-unit graphic forms, 

said computer program comprising: 

an interpolated line computation step that determines the interpolated line that is the line that 
interpolates a space between two vertices from an interpolation vector used for determining the line that 
interpolates a space between a given vertex and another vertex of the vertices of said unit graphic forms 
and from coordinates of said vertices, and 

an interpolated point computation step that determines, as the vertices of said sub-unit graphic forms, 
interpolated points that are points on said interpolated line. 

50. The program distribution medium as described in claim 49, wherein 

50 

if a unit graphic form has first through fourth vertices, a line segment which joins first and second 
vertices thereof and a line segment that joins third and fourth vertices thereof line segment that joins 
said second and fourth vertices lie opposite each other, 

said interpolated line computation step determines a first interpolated line that interpolates a space 
55 between said first and second vertices, a second interpolated line that interpolates said third and fourth 

vertices, a third interpolated line that interpolates a space between said first and third vertices, and a 
fourth interpolated line that interpolates said second and fourth vertices, and also determines a fifth 
interpolated line that interpolates a space between an interpolated point on said first interpolated line 
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and an interpolated point on said second interpolated line, and 

said interpolated point computation step determines the interpolated points on said first through fifth 
interpolated lines as vertices of said sub-unit graphic forms. 



The program distribution medium as described in claim 50, wherein 

said computer program further comprises an interpolation vector computation step that determines said 
interpolation vector at interpolated points on said first interpolated line from said interpolation vector 
at said first and second vertices and determines said interpolation vector at interpolated points on said 
second interpolated line from said interpolation vector at said third and fourth vertices, and 

said interpolated line computation step determines said fifth interpolated line from said interpolation 
vector at interpolated points on said first and second interpolated lines and from the coordinates of the 
interpolated points. 



52. The program distribution medium as described in claim 51 , wherein 

said interpolation vectors at said first through fourth vertices of said unit graphic forms are normal- 
direction normal vectors of the shape to be realized by said unit graphic forms. 



53. The program distribution medium as described in claim 51, wherein 

said interpolation vectors at said first through fourth vertices of said unit graphic forms are vectors 
which define the direction at said first through fourth vertices of each said interpolated line that passes 
through said first through fourth vertices, respectively. 



54. The program distribution medium as described in claim 52, wherein 

said interpolation vectors at said first through fourth vertices of said unit graphic forms further include, 
in addition to said normal vectors, interpolated line direction vectors which define a direction at said 
first through fourth vertices of each said interpolated line that passes through said first throuqh fourth 
vertices, respectively. 



35 55. The program distribution medium as described in claim 54, wherein 

said interpolated line computation step determines said first through fourth interpolated lines using said 
interpolated line direction vectors, and 

said interpolation vector computation step determines said interpolation vectors at interpolated points on 
40 said first and second interpolated lines using said normal vectors. 



56. The program distribution medium as described in claim 50, wherein 



45 anv one set of vertices among said first and second vertices, said third and fourth vertices, said first and 

third vertices, or said second and fourth vertices are the same vertices. 



57. The program distribution medium as described in claim 49, wherein 

50 said interpolation vectors at vertices of said unit graphic forms are normal-direction normal vectors of the 

shape to be produced by said unit graphic forms. 



58. The program distribution medium as described in claim 57, wherein 

55 said interpolation vectors at the vertices of said unit graphic forms further include, in addition to said 

normal vectors, vectors which define a direction of said interpolated lines at said vertices. 
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59. The program distribution medium as described in claim 49, wherein 

said interpolation vectors at the vertices of said unit graphic forms are interpolated line direction 
vectors which define a direction of said interpolated lines at said vertices. 

5 

60. The program distribution medium as described in claim 59, wherein 

if, in a prescribed plane that includes said vertices, said interpolated line is touched by a line onto 
which is projected a line segment which joins a given vertex and another vertex, said interpolated line 
10 direction vectors are normal-direction vectors in said prescribed plane. 

61. The program distribution medium as described in claim 59, wherein 

said interpolated line direction vectors are vectors which define a tangent direction of said interpolated 
15 lines at said vertices. 

62. The program distribution medium as described in claim 49, wherein 

said computer program further includes an interpolation vector computation step that determines, from 

20 interpolation vectors at said vertices, the interpolation vector to be used for determining the line that 

interpolates the space between a given interpolated point and another interpolated point in said 
interpolated points. 



25 



63. The program distribution medium as described in claim 62, wherein 

when a ratio of the values corresponding to a distance from said interpolated point between one vertex and 
another vertex to said one vertex or to the other vertex, respectively, is denoted by t:1-t t 

said interpolation vector computation step determines as the interpolation vector at said interpolated point 
30 the result corresponding to the sum of (1-t) times the interpolation vector at said one vertex plus t times 

the interpolation vector at said other vertex. 

64. The program distribution medium as described in claim 63, wherein 

35 said computer program further includes a correction step that corrects the interpolation vector at said 

interpolated point determined by said interpolation vector computation step. 

65. The program distribution medium as described in claim 64, wherein 
40 said correction step 

determines a vector product of the interpolation vector at said interpolated point determined by said 
interpolation vector computation step and a tangent-direction tangent vector of said interpolated line at 
said interpolated point, 

45 determines the vector product of said vector product and said tangent vector, and 

takes the resulting vector as a post-correction interpolation vector at said interpolated point 

50 66. The program distribution medium as described in claim 65, wherein 
said image is a three-dimensional image, and 

said program further includes a rendering step that renders said sub-unit graphic forms. 



55 



67. The program distribution medium as described in claim 66, wherein 

said rendering step performs shading based on said post-correction interpolation vector. 
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The program distribution medium as described in claim 49, wherein 
said interpolated line is a Bezier curve. 



The program distribution medium as described in claim 68, wherein 
said image is a three-dimensional image; and 
said interpolated line computation step includes: 

an angle computation step that determines a first or second angle formed by a straight line that joins one 
vertex and another vertex interpolated by said interpolated line, which is said Bezier curve, and each 
projection of the straight line onto a plane perpendicular to the interpolation vector at said one vertex or 
other vertex, which is a plane that includes said one vertex or other vertex, 

a distance computation step that determines, based on said first and second angles, a first or second 
control edge length, which is the distance from said one vertex or other vertex to a first or second control 
point of said Bezier curve, and 

a Bezier curve computation step that determines said Bezier curve as the interpolated line that interpolates 
the space between said one vertex and other vertex by determining, based on said first or second control 
edge length, each said first and second control points 2. 

The program distribution medium as described in claim 49, wherein 

if the coordinates of the vertices of said unit graphic forms and the interpolation vectors are recorded on 
a recording medium, 

said computer program further includes a playback step which plays back from the recording medium the 
coordinates of said vertices and the interpolation vectors. 



The program distribution medium as described in claim 49, wherein 

if the coordinates of the vertices of said unit graphic forms and the interpolation vectors are transmitted 
via a transmission route, 

said computer program further includes a reception step that receives the coordinates of said vertices and 
the interpolation vectors transmitted via the transmission route. 



The program distribution medium as described in claim 49, wherein 
said image is a three-dimensional image, 

said computer has an operation means which is operated when a prescribed input is given, and 
said computer program further includes: 

a geometry processing step that reads data concerning said unit graphic forms from a recording medium and 
with respect to the data performs geometry processing that corresponds to an input from said operation means, 

a conversion step that converts said sub-unit graphic forms obtained by splitting said unit graphic forms 
resulting after said geometry processing into ones in the coordinate system of a two-dimensional output 
device, and 

a rendering step that renders said sub-unit graphic forms converted by said conversion step. 

The program distribution medium as described in claim 49, which 

also provides the coordinates of the vertices of said unit graphic forms and the interpolation vectors. 
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74. An image processing device for processing an image defined by a combination of unit graphic forms, comprising; 

an operation means which is operated when said unit graphic forms are input thereto, 

an interpolation vector generation means for generating interpolation vectors used for determining an 
interpolated line that is the tine that interpolates a space between a given vertex and another vertex in 
vertices of said unit graphic forms input by said operation means when said operation means are operated, and 

a provision means for providing coordinates of the vertices of said unit graphic forms and the interpolation 
vectors. r 

75. The image processing device as described in claim 74, wherein 

said provision means provides by recording on a recording medium the coordinates of the vertices of said 
unit graphic forms and the interpolation vectors. 

76. The image processing device as described in claim 74, wherein 

said provision means provides by transmitting via a transmission route the coordinates of the vertices of 
said unit graphic forms and the interpolation vectors. 

77. The image processing device as described in claim 74, wherein 

said interpolation vector generation means generates as said interpolation vectors, normal-direction normal 
vectors of the shape to be produced by said unit graphic forms. 

78. The image processing device as described in claim 77, wherein 

said interpolation vector generation means also generates as said interpolation vectors, in addition to said 
normal vectors, vectors which define directions of said interpolated lines at 
said vertices. 

). The image processing device as described in claim 74, wherein 

said interpolation vector generation means generates as said interpolation vectors interpolated line 
direction vectors which define the direction of said interpolated lines at said vertices. 

). The image processing device as described in claim 79, wherein 

if, in a prescribed plane that includes said vertices, said interpolated line is touched by a line onto 
which is projected a line segment that joins a given vertex and another vertex, said interpolated line 
direction vectors are normal-direction vectors in said prescribed plane. 

. The image processing device as described in claim 79, wherein 

said interpolated line direction vectors are vectors which define a tangent direction of said interpolated 
lines at said vertices. 

. The image processing device as described in claim 74, and further comprising: 

a splitting means for splitting said unit graphic forms into multiple sub-unit graphic forms based on the 
coordinates of said vertices and the interpolation vectors; and 

a rendering means for rendering said sub-unit graphic forms. 
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83. The image processing device as described in claim 82, wherein 
said splitting means includes: 

an interpolated line computation means for determining said interpolated lines based on the coordinates of 
said vertices and said interpolation vectors, and 

an interpolated point computation means for determining, as the vertices of said sub-unit graphic forms, 
interpolated points that are points on said interpolated line. 



84. The image processing device as described in claim 83, wherein 

said splitting means further includes an interpolation vector computation means for determining from the 
interpolation vectors at said vertices, interpolation vectors used for determining a line that interpolates 
the space between a given interpolated point and another interpolated point in said interpolated points. 



85. The image processing device as described in claim 84, wherein 



when a ratio of the values corresponding to a distance from said interpolated point between one vertex and 
another vertex to said one vertex or to the other vertex, respectively, is denoted by t:1-t, 

said interpolation vector computation means determines as the interpolation vector at said interpolated 
point the result corresponding to the sum of (1-t) times the interpolation vector at said one vertex plus t 
times the interpolation vector at said other vertex. 

86. The image processing device as described in claim 85, wherein 

said splitting means further includes a correction means for correcting the interpolation vector at said 
interpolated point determined by said interpolation vector computation means. 

87. The image processing device as described in claim 86, wherein 

said correction means 

determines a vector product of the interpolation vector at said interpolated point determined by said 
35 interpolation vector computation means and a tangent-direction tangent vector of said interpolated line at 

said interpolated point, 

determines the vector product of said vector product and said tangent vector, and 
takes the resulting vector as a post-correction interpolation vector at said interpolated point 
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88. The image processing device as described in claim 87, wherein 

said rendering means performs shading based on said post-correction interpolation vector. 

89. The image processing device as described in claim 83, wherein 

said interpolated line is a Bezier curve. 



50 

90. The image processing device as described in claim 89, wherein 
said image is a three-dimensional image, and 



said interpolated line computation means includes: 

55 

an angle computation means that determines a first or second angle formed by a straight line that joins one 
vertex and another vertex interpolated by said interpolated line, which is said Bezier curve, and each 
projection of the straight line onto a plane perpendicular to the interpolation vector at said one vertex or 
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other vertex, which is a plane that includes said one vertex or other vertex, 

a distance computation means that determines, based on said first and second angles, a first or second 
control edge length, which is the distance from said one vertex or other vertex to a first or second control 
point of said Bezier curve, and 

a Bezier curve computation means that determines said Bezier curve as the interpolated line that 
interpolates the space between said one vertex and other vertex by determining, based on said first or 
second control edge length, each said a first and second control points. 



91. An image processing method for an image processing device that processes an image defined by a combination 
of unit graphic forms, said image processing device including an operation means which is operated when said unit 
graphic forms are input, the image processing method comprising: 

an interpolation vector generation step of generating interpolation vectors used for determining an 
interpolated line which is the line that interpolates a space between a given vertex and another vertex in 
vertices of said unit graphic forms input by said operation means when said operation means is operated; and 

a provision step of providing coordinates of the vertices of said unit graphic forms and the interpolation vectors. 



92. The image processing method as described in claim 91, wherein 

said provision step provides by recording on a recording medium the coordinates of the vertices of said unit 
graphic forms and the interpolation vectors. 



93. The image processing method as described in claim 91, wherein 

said provision step provides by transmitting via a transmission route the coordinates of the vertices of 
said unit graphic forms and the interpolation vectors. 



94. The image processing method as described in claim 91, wherein 

said interpolation vector generation step generates as said interpolation vectors normal-direction normal 
vectors of the shape to be produced by said unit graphic forms. 



95. The image processing method as described in claim 94, wherein 

said interpolation vector generation step further generates as said interpolation vectors, in addition to 
said normal vectors, vectors which define the direction of said interpolated lines at said vertices. 



96. The image processing method as described in claim 91, wherein 

said interpolation vector generation step generates as said interpolation vectors interpolated line 
direction vectors which define the direction of said interpolated lines at said vertices. 



97. The image processing method as described in claim 96, wherein 

if, in a prescribed plane that includes said vertices, said interpolated line is touched by a line onto 
which is projected a line segment that joins a given vertex and another vertex, then said interpolated line 
direction vectors are normal-direction vectors in said prescribed plane. 



98. The image processing method as described in claim 96, wherein 

said interpolated line direction vectors are vectors that express the tangent direction of said interpolated 
lines at said vertices. 



99. The image processing method as described in claim 96, and further comprising: 
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a splitting step of splitting said unit graphic forms into multiple sub-unit graphic forms based on the 
coordinates of said vertices and the interpolation vectors, and 

a rendering step of rendering said sub-unit graphic forms. 

100. The image processing method as described in claim 99, wherein 
said splitting step includes: 

an interpolated line computation step of determining said interpolated lines based on the coordinates of 
said vertices and said interpolation vectors, and 

an interpolated point computation step of determining, as the vertices of said sub-unit graphic forms, 
interpolated points that are points on said interpolated line. 



101. The image processing method as described in claim 100, wherein 

said splitting step further includes an interpolation vector computation step of determining, from the 
interpolation vectors at said vertices, interpolation vectors used for determining a line that interpolates 
20 a space between a given interpolated point and another interpolated point in said interpolated points. 

102. The image processing method as described in claim 101, wherein 



when a ratio of the values corresponding to a distance from said interpolated point between one vertex and 
another vertex to said one vertex or to the other vertex, respectively, is denoted by T:1-T, 

said interpolation vector computation step determines as the interpolation vector at said interpolated point 
the result corresponding to the sum of (1-T) times the interpolation vector at said one vertex plus T times 
the interpolation vector at said other vertex. 



103. The image processing method as described in claim 102, wherein 

said splitting step further includes a correction step of correcting the interpolation vector at said 
interpolated point determined by said interpolation vector computation step. 

104. The image processing method as described in claim 103, wherein 

said correction step 

40 determines a vector product of the interpolation vector at said interpolated point determined by said 

interpolation vector computation step and a tangent-direction tangent vector of said interpolated line at 
said interpolated point, 



determines the vector product of said vector product and said tangent vector, and 

takes the resulting vector as the post-correction interpolation vector at said interpolated point. 



105. The image processing method as described in claim 104, wherein 

50 said rendering step performs shading based on said post-correction interpolation vector. 

106. The image processing method as described in claim 100, wherein 

said interpolated line is a Bezier curve. 



107. The image processing method as described in claim 106, wherein 
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said image is a three-dimensional image, and 



said interpolated line computation step has 

an angle computation step that determines a first or second angle formed by the straight line that joins one 
vertex and another vertex interpolated by said interpolated line, which is said Bezier curve, and each 
projection of the straight line onto a plane perpendicular to the interpolation vector at said one vertex or 
other vertex, which is a plane that includes said one vertex or other vertex, 

a distance computation step that determines, based on said first and second angles, a first or second 
control edge length,, which is the distance from said one vertex or other vertex to a first or second control 
point of said Bezier curve, and 

a Bezier curve computation step that determines said Bezier curve as the interpolated line that interpolates 
the space between said one vertex and other vertex by determining, based on said first or second control 
edge length, each said first or second control point. 



108. A program distribution medium which provides a computer program to cause a computer to process an image 
defined by a combination of unit graphic forms, 

said computer including an operation means which is operated when unit graphic forms are input thereto, and 

the computer program provided by the program distribution medium comprising 

an interpolation vector generation step which generates interpolation vectors used for determining an 
interpolated line that is the line that interpolates a space between a given vertex and another vertex in 
vertices of said unit graphic forms input by said operation means when said operation means is operated, and 

a provision step of providing coordinates of the vertices of said unit graphic forms and the interpolation vectors. 



109. The program distribution medium as described in claim 108, wherein 

30 

said provision step provides by recording on a recording medium the coordinates of the vertices of said unit 
graphic forms and the interpolation vectors. 

110. The program distribution medium as described in claim 108, wherein 

35 

said provision step provides by transmitting via a transmission route the coordinates of the vertices of 
said unit graphic forms and the interpolation vectors. 



111. The program distribution medium as described in claim 108, wherein 

40 

said interpolation vector generation step generates as said interpolation vectors, normal-direction normal 
vectors of a shape to be produced by said unit graphic forms. 



45 



112. The program distribution medium as described in claim 111, wherein 

said interpolation vector generation step further generates as said interpolation vectors, in addition to 
said normal vectors, vectors which define the direction of said interpolated lines at said vertices. 



5 0 113. The program distribution medium as described in claim 108, wherein 

said interpolation vector generation step generates as said interpolation vectors interpolated line 
direction vectors which define directions of said interpolated lines at said vertices. 

55 114. The program distribution medium as described in claim 113, wherein 

if, in a prescribed plane that includes said vertices, said interpolated line is touched by a line onto 
which is projected a line segment that joins a given vertex and another vertex, said interpolated line 
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direction vectors are normal-direction vectors in said prescribed plane. 

115. The program distribution medium as described in claim 113, wherein 

said interpolated line direction vectors are vectors which define a tangent direction of said interpolated 
lines at said vertices. 

116. The program distribution medium as described in claim 108, wherein 

said computer program further comprises 

a splitting step that splits said unit graphic forms into multiple sub-unit graphic forms based on the 
coordinates of said vertices and the interpolation vectors, and 

15 a rendering step that renders said sub-unit graphic forms. 

117. The program distribution medium as described in claim 116, wherein 
said splitting step includes 
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an interpolated line computation step which determines said interpolated lines based on the coordinates of 
said vertices and said interpolation vectors, and 

an interpolated point computation step that determines, as the vertices of said sub-unit graphic forms, 
interpolated points that are points on said interpolated line. 



118. The program distribution medium as described in claim 117, wherein 

said splitting step further includes an interpolation vector computation step that determines, from the 
30 interpolation vectors at said vertices, interpolation vectors used for determining a line that interpolates 

a space between a given interpolated point and another interpolated point in said interpolated points. 

119. The program distribution medium as described in claim 118, wherein 

35 when a ratio of the values corresponding to a distance from said interpolated point between one vertex and 

another vertex to said one vertex or to the other vertex, respectively, is denoted by t:1-t, 

said interpolation vector computation step determines as the interpolation vector at said interpolated point 
the result corresponding to the sum of (1-t) times the interpolation vector at said one vertex plus t times 
the interpolation vector at said other vertex. 



120. The program distribution medium as described in claim 119, wherein 

said splitting step further includes a correction step that corrects the interpolation vector at said 
interpolated point determined by said interpolation vector computation step. 

121. The program distribution medium as described in claim 120, wherein 

said correction step 

determines a vector product of the interpolation vector at said interpolated point determined by said 
interpolation vector computation step and a tangent-direction tangent vector of said interpolated line at 
said interpolated point, 

determines the vector product of said vector product and said tangent vector, and 

takes the resulting vector as the post-correction interpolation vector at said interpolated point. 
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22. The program distribution medium as described in claim 121, wherein 

said rendering step performs shading based on said post-correction interpolation vector. 



23. The program distribution medium as described in ciaim 117, wherein 
said interpolated line is a Bezier curve. 



24. The program distribution medium as described in claim 123, wherein 
said image is a three-dimensional image, and 
said interpolated line computation step includes: 

an angle computation step that determines a first or second angle formed by a straight line that joins one 
vertex and another vertex interpolated by said interpolated line, which is said Bezier curve, and each 
projection of the straight line onto a plane perpendicular to the interpolation vector at said one vertex or 
other vertex, which is a plane that includes said one vertex or other vertex, 

a distance computation step that determines, based on said first and second angles, a first or second 
control edge length, which is the distance from said one vertex or other vertex to a first or second control 
point of said Bezier curve, and 

a Bezier curve computation step that determines said Bezier curve as the interpolated line that interpolates 
the space between said one vertex and other vertex by determining, based on said first or second control 
edge length, each said first and second control points. 



25. A data distribution medium that provides data concerning images defined by a combination of unit graphic forms, 
wherein 

if a unit graphic form is input, then by generating interpolation vectors used for determining an 
interpolated line that is the line that interpolates a space between a given vertex and another vertex in 
vertices of the unit graphic form, 

it provides as data concerning said image, at least interpolation vectors at said vertices and coordinates 
of said vertices thus obtained. 



26. The data distribution medium as described in claim 125, wherein 

said interpolation vectors are normal-direction normal vectors of the shape to be produced by said unit 
graphic forms. 



27. The data distribution medium as described in claim 126, wherein 

said interpolation vectors further include, in addition to said normal vectors, vectors which define a 
direction of said interpolated lines at said vertices. 



28. The data distribution medium as described in claim 125, wherein 

said interpolation vectors are interpolated line direction vectors which define the direction of said 
interpolated lines at said vertices. 



29. The data distribution medium as described in claim 128, wherein 

if, in a prescribed plane that includes said vertices, said interpolated line is touched by a line onto 
which is projected a line segment that joins a given vertex and another vertex, said interpolated line 
direction vectors are normal-direction vectors in said prescribed plane. 
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130. The data distribution medium as described in claim 128, wherein 

said interpolated line direction vectors are vectors which define a tangent direction of said interpolated 
lines at said vertices. 

5 

131. The data distribution medium as described in claim 125, wherein 

said interpolated line is a Bezier curve. 



132. The data distribution medium as described in claim 125, wherein 
said image is a three-dimensional image. 



15 133. An image processing device for processing images defined by a combination of unit graphic forms, comprising: 
a provision device for providing data concerning an image, and 

a client device for receiving a provision of the data from said provision device and splitting unit graphic 
forms defining the image into multiple sub-unit graphic forms; 

20 

said provision device including: 

an operation means which is operated when said unit graphic forms are input, 

an interpolation vector generation means for generating interpolation vectors used for determining an 
interpolated line that is the line that interpolates a space between a given vertex and another vertex in 
vertices of said unit graphic forms input by said operation means when said operation means is operated, and 

a provision means for providing to said client device coordinates of the vertices of said unit graphic forms 
and the interpolation vectors; and 

30 

said client device including: 

an interpolated line computation means for determining said interpolated lines from the coordinates of the 
vertices of said unit graphic forms and from said interpolation vectors, 

35 an interpolated point computation means for determining, as the vertices of said sub-unit graphic forms, 

interpolated points that are points on said interpolated lines, 

a conversion means for converting said sub-unit graphic forms into ones in a coordinate system of a two- 
dimensional output device, and 

40 a rendering means for rendering said sub-unit graphic forms converted by said conversion means. 
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